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Abstract 


Australian  Army  Officers  in  the  ranks  of  Lieutenant  Colimiel  ard 
Major  cco^leted  questionnaires  about  familiarity  with  management  interventions 
and  select  management  techniques.  Responses  were  ccnpared  with  percepticsis  of 
effectiveness,  i-  ;kground  and  organisational  factors.  Data  were  analysed 
using  a  linear  structural  model  (LISREL).  Main  results  were  a  positive 
relationship  betwe«i  a  set  of  11  management  interventions  and  perceived 
effectiveness  and  a  stronger  correlatitsi  between  familiarity  with  management 
interventions  and  a  select  list  of  management  techniques.  In  additicai,  a 
moderate  relationship  was  found  between  job  satisfaction  and  perceived 
effectiveness.  Results  are  discussed  in  the  context  of  Implementation  of  a 
proposed  model  of  effectiveness  Improvement. 


The  findings  and  views  expressed  in  this  report  are  the  result  of 
the  author's  research  stixiles  and  are  not  to  be  taken  as  the  officiail  opinion 
of  the  Department  of  Defence  (Army  Office) . 
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In  the  1970s  there  Mas  a  sudden  sMareness  in  the  United  States 
(U.S. )  that  there  had  been  a  r^^ld  decrease  in  productivity  as  represented  by 
the  Bureau  of  Labor  statistics.  These  average  yearly  chan^  in  U.S. 
productivity  growth  per  year  are  quoted  in  Tuttle  (1983)  as  follows:  for  the 
period  1947-1967  growth  was  3.2*  (average).  Subsequently  the  figure  actually 
indicated  negative  growth;  for  the  individual  years  1976  -  0.2*;  1979  -  0.4*; 
1980  -  0.4*. 

Business  Meele  in  its  July  24,  1978  issue  reported  that  productivity 
growth  was  only  two-thirds  of  vhat  it  had  been  in  the  1960s.  These  sorts  of 
figures  "caused  many  executives  and  administrators  to  conclude  that 
productivity  improvanent  had  become  urgent  not  Just  desirable."  (p.l46) 

Judscn  (1982)  in  a  study  of  236  top  level  eseecutives  representing  a 
cross  section  of  195  U.S.  industrial  companies  found  that  32*  of  these 
companies  experienced  a  decline  in  productivity  and  25*  of  the  respondmts  did 
not  even  know  vdtat  their  company's  productivity  perfonnance  had  been.  The 
conclusion  reached  vas  that  management  ineffectiveness  was  by  far  the  single 
greatest  cause  of  declining  productivity  in  the  U.S.  In  looking  at  any  of 
these  productivity  figures  it  is  worth  noting,  as  in  Alluisl  and  Meigs  (1983), 
that  there  is  no  measure  of  national  productivity  that  includes  both  the 
private  and  Govemnent  sectors.  U.S.  Government  response  to  the  problem  of 
declining  productivity  was  legislation  in  the  form  of  Public  Ism  94-135  of 
1975  aimed  at  stimulating  efforts  to  accurately  measure  productivity 
improvement  efforts  and  to  encourage  those  efforts.  FOr  military 
organlsatl<xis  the  law  was  followed  by  a  Defence  instruction  which  in  turn  was 
followed  by  instructions  for  each  military  service. 

The- Problem  of  Definition 

Researcdters  in  the  area  have  always  been  tampered  by  the  problem  of 
determining  operatloral  deflnltlans  for  productivity,  effectiveness  and 
efficiency  and  the'  relationship  between  the  three.  The  problem  will  never  be 
completely  resolved  because  the  definitlcns  change  according  to  the 
researcher's  per^)ective.  The  econcmist,  engineer,  accountant,  manager  and 
psychologist  all  have  different  perspectives  and  thus  different  definitions 
(Tuttle,  1981).  The  current  study  will  adopt  the  following  definitions: 

a.  "Productivity",  as  distinct  from  production,  is  defined  as  woricloeki 
and  gcjal  acconpllshment  and  incorporates  both  effectiveness  and 
efficiency.  In  the  military  context,  peacetime  focus  is  on 
efficiency  -  in  vmrtlme,  effectiveness  is  all  that  matters. 

b.  "Effectiveness"  is  the  degree  to  which  an  organisation  achieves  its 
goals  (Price,  1977) ,  and 

c.  "Efficiency"  is  a  ratio  that  rbflects  tlie  cost  incurred  for  that 
performance. 

In  simple  tens  effectiveness  is  "doing  the  right  things", 
efficiency  is  "doing  things  rls^t"  (Tattle,  1983,  p.  483)  and  productivity 
has  elements  of  both.  In  the  military  context  effectiveness  is  generally  a 
more  a^iproprlate  term  than  productivity  because  of  the  ccnfuslon  between 
productlcn  and  the  term  productivity. 
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The  Question  of  Measureaent 

For  measurement  purposes,  Pennings  and  Goodman  (1977)  define 
organisational  effectiveness  in  tenas  of  constraints,  goals  and  referents. 
"Organisations  are  effective  if  relevant  constraints  can  be  satisfied  and  if 
organisation  results  a^ipraxlaate  or  eseceed  a  set  of  referents  for  multiple 
goals."  "Constraints"  appear  in  organisations  as  policy  statements  or 
decision  rules  that  guide  behaviour.  Organisation  "goals"  represent  desired 
end  states  specified  by  the  dominant  coalition.  "Referents"  are  the  standards 
against  which  constraints  and  goals  evaluated.  They  can  be  internal  or 
external  to  the  organisation  and  can  be  categorised  as  static  or  dynamic.  It 
is  highly  unlikely  that  effectiveness  can  be  evaluated  with  a  single  referent. 
For  each  constraint  or  goal,  multiple  referents  nay  be  assigned.  Referents 
are  generally  called  measuremmit  Indicators.  As  such,  measurement  indicators 
are  a  substitute  for  direct  observation  and  have  to  be  considered  in  cost- 
effectiveness  tens. 

Measureable  general  aspects  of  productivity  (Guzzo  and  Bendy,  1983) 
are  output  (quantity  and  quality,  cost  effectiveness),  withdrawal  (turnover, 
atsenteeism) ,  and  disruption  (accidents,  strikes).  On^ibell  (1977)  proposed  a 
more  detailed  set  of  organisational  effectiveness  Indices.  Tuttle  and  Heaver 
(1986)  lists  three  measureable  aspects  (and  efficiency)  with  the  emphasis  cn 
detailed  measuremoit  (see  Figure  1).  Other  authors  would  use  structural 
measures  of  organisational  effectiveness  Including  the  degree  of 
organisational  innovation  (Mohr  in  Rowe  and  Boise,  1973)  and  staff  mobility 
and  career  develqpnent  (Klrkhardt  in  Marini,  1971).  Criteria  change  as  an 
organisation  changes  and  as  the  environmental  contexts  in  vdiidi  organisations 
exist  are  themselves  changing  -  "The  casual  texture  of  the  environment"  (Bnery 
and  Trlst,  1969) .  In  the  military  context  there  are  also  factors  such  as 
Government  attitudes  to  military  spoiding  and  public  attitudes  towards 
military  service.  These  are  factors  which  are  beyond  the  control  of  the 
organisation,  but  vhich  it  must  respond  to  as  pert  of  the  turbulent 
environment  in  which  it  operates. 

The  task  of  translating  a  goal  into  a  set  of  measurement  indicators 
is  generally  ^lite  conplex.  The  best  detailed  description  of  the  process  with 
exanples  is  to  be  found  in  Tuttle  (1981)  and  Somers,  Locke  and  Tuttle  (1985). 
Hurst  (in  Tuttle,  1981  p.33)  has  described  the  characteristics  of  good 
productivity  measures  as  being  controllable,  congruent,  measureable, 
unequivocal,  reproducible,  accurate  and  objective.  In  addition,  measurement 
has  to  be  appropriate  to  the  level  of  analysis  (individual,  groiq>  €uid  ^ 
organisational).  '  * 
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Figure  l 

Criterion  Measures  of  Oroanlsatlcgial  Effectiveness 
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The  Degree  of  Success  of  Productivity  laprovement  Proaramnes 

Guzzo,  Jette  and  Katzell  (1985)  have  sunmarised  the  detailed 
fitxlings  of  Katzell,  Blenstode  and  Faersteln  (1977)  and  Guzzo  and  Bendy  (1983) 
in  analysing  207  productivity  experiments  for  the  period  1971-1981.  TO  be 
included,  experiments  had  to  talce  place  In  "real"  organisations  and  had  to 
have  enf>loved  at  least  one  concrete  measure  of  productivity  as  a  dependent 
varl2d3le.  Interventions  v«ere  groiqjed  under  11  rubrics:  recruitment  and 
selection;  training  and  Instruction;  appraisal  and  feedback;  goal  setting; 
financial  compensation;  work  redesign;  st^^rvisory  methods;  organisation 
structure;  decislcm  making  techniques;  and  work  schedules  sociotechnlcal 
system  redesign.  The  general  finding  was  that  87K  of  the  studies  has  at  least 
one  positive  result.  Guzzo,  Jette  and  Katzell  (1985)  eqiplied  meta  anedysis  to 
98  of  the  207  experiments  that  did  not  omit  needed  data. 

The  findings  were: 

a.  As  a  whole,  the  98  experiments  significantly  laproved  a  concrete 
aspect  of  productivity  by  necurly  one-half  a  standard  deviation 
(.44). 

b.  The  quantity  and  quality  of  worker  output  were  generally  more 
amenable  to  Improvement  than  aspects  of  withdrawal 
(turnover /absenteeism) . 

c.  Frogrsnmes  Involving  training,  goeQ  setting  and  sociotechnlcal 
systems  design  were  the  most  powerful. 

d.  Interventions  Involving  chenges  In  supervisory  methods  and  work 
schedules  had  significantly  positive  effects  on  withdrawal. 

e.  The  only  progranme  with  a  statistically  significant  effect  on 
dlsrvq>tlons  was  goal  setting,  and 

f.  The  Ispact  of  interventions  on  Government  (including  military)  was 
8ubstantl€tlly  greater  than  that  in  other  types  of  organisation. 

The  general  ooncluslon  reached  was  that  bdiavioural  science 
techniques  for  Increasing  productivity  are,  on  the  v8>ole,  effective.  Mien 
converted  Into  cost  benefit  terminology  (as  has  been  done  in  many  of  the 
military  studies)  the  productivity  inpxovements  2ure  very  dramatic  Indeed 
In  tetms  of  dolleurs  saved. 

Effectiveness  In  the  Military  Context 

A  significant  number  of  the  207  productivity  esqmrlments  analysed  by 
Katzell  et  al  (1977)  and  Guzzo  and  Bandy  (1983)  took  place  In  military 
settings.  The  Impression  drawn  from  the  individual  abstracts  is  that  military 
organisations  are  at  the  forefront  in  atteepts  to  increase  organisational 
effectiveness. 

There  la  little  doubt  that  military  organisations  can  be  contrasted 
with  other  organisations  In  their  selection  of  goals  and  the  way  they  approach 
those  goals.  Segal  and  Segal  (1983)  distinguish  milltiUY  organisations  on  the 
basis  of  Intense  socialisation,  an  emphasis  on  "belonglnspiess"  goals  and  a 
desire  to  maintain  social  solidarity  in  an  Increasingly  Individualistic  social 
envlronnent.  Cohen  and  Turney  (1978)  and  Turney  and  Cohen  (1978)  see  the  real 
distinction  as  being  the  rigid  chain  of  waiswul  structure  and  the  total 
lamerslon  environment  -  "The  permeation  of  the  Anny  Into  all  aspects  of  a 
soldier's  life  significantly  extends  the  concept  of  the  work  environment 
beyond  the  confines  of  a  single  phyalcal  work  facility  and  a  40  hour  woik 
wok*  ” 


There  is  also  a  wide  spread  attitude  in  military  organlsaticn  (Cahn 
and  Nadel,  1978)  that  the  militaiv  is  a  unique  institution  that  has  to  do 
things  in  a  particular  way  becavise  ailitary  goals  are  different  and  cilivian 
experience  does  not  aqiply.  This  is  in  addition  to  a  frequently  recurring 
attitude  that  the  military  trains  "leaders"  and  any  enphasls  on  manageraent 
training  somehow  detracts  from  the  leadership  role.  This  is  misleading.  At 
the  Infantry  platoon  level  the  emphasis  is  otx^iously  on  leadership;  for  the 
logistician  the  emphasis  is  likely  to  be  on  management.  The  fact  is  that  the 
military  officer  is  a  "problem  solver"  who  is  likely  to  spend  much  of  his  time 
dealing  with  problems  of  management  and  leadership. 

The  ultimate  goal  in  military  organisations  is  "effective  war 
flS^ting",  but  to  attedn  this  goal  omy  require  many  sub  goeils  (operational  and 
personnel  management)  at  all  levels  of  the  organisation. 

Effectiveness  Improvenent  Efforts  in  Millteav  Settings 

Military  organisations  in  some  Instances  have  laorrowed  techniques 
that  have  originated  in  civilian  settings.  A  good  example  of  this  is  the 
Incnreased  use  of  surveys  to  determine  organisational  funcrtlonlng  and  quality 
of  work  life  (Farkas,  1983;  Jans,  1985).  In  one  instance  survey  data  have 
formed  the  basis  of  a  service  wide  Orginisaticnal  Effectiveness  programae. 

This  was  the  develcpment  and  use  of  an  orgenisatlonal  assessment  procedure  in 
the  United  States  Air  Fbrce  (Hendrix  and  Halverson,  1979) .  By  1984  the  survey 
had  been  administered  to  almost  5000  military  and  civilian  personnel  in  the 
Uhlted  States  Air  Force  (U.S.A.F.).  The  survey  instrument  used  in  the  current 
study  owes  much  of  its  format  to  the  survey  devel(^»d  for  the  U.S.A.F. 

Quality  Circles  (QCs)  are  another  example  of  a  technique  used  in 
civilian  enterprises  far  many  years  taefore  its  eventual  use  in  the  U.S.  Army 
(Schnieder,  1985)  and  the  U.S.  Navy  (Atwater  and  Sander,  1984).  QCs  in  the 
U.S.  differ  from  QCs  that  had  originated  in  Japan  v4¥sre  the  prcgraames  give 
greater  emphasis  to  statistical  qprality  cxntrol  and  where  eg^loyees  often  meet 
in  their  am  time  and  usurdly  receive  a  flnancied  bonus  for  the  performance  of 
the  organisation.  In  the  U.S.  QCs  "bcxined"  to  the  point  tdiere  they  were  a 
"fad"  (Lawler  and  Mahrman,  1985).  m  1982  the  New  York  Stock  Exchange 
estimated  that  44!l!  of  all  companies  with  more  than  500  employees  had  QC 
progranines.  While  QCs  have  no  decision  making  powers,  nenagers  in  many  cases 
felt  pressured  to  accept  all  suggestiois  coming  cut  of  QCs.  Even  thc»^  most 
QCs  go  into  a  period  of  decline  viiere  social  satisfaction  takes  over  from 
group  problem  solving  effectiveness,  the  fourt  remains  that  QC  progranmes  can 
effectively  collect  the  ideas  of  the  Individuals  closest  to  the  work  (Lawler 
and  Mohrman,  1985) . 


The  use  of  QCs  in  defence  organisations  has  had  some  very  notable 
successes,  though  In  most  cases  they  have  not  been  used  with  servicemen 
themselves,  presunably  because  they  are  scmdww  seen  as  being  inconsistent 
with  prltx;lple8  of  military  discipline.  The  most  quoted  QC  success  (Bryant 
and  Kbams,  1982)  took  place  in  the  Norfolk  Naval  shipyard  where  QCs  analysed 
problems  using  cause  and  effect  analysis  and  value  analysis  techniques  to 
taring  about  the  net  savings  of  $215,000  in  the  first  year.  This  represented  a 
"beneflt-coet"  ratio  of  4  to  1.  Korb  (1985)  reported  a  QC  at  the  Norfolk  Air 
RewDrtc  facility  saving  $300,000  a  year  with  a  single  suggesticn.  Another  at 
the  Defence  Logistics  Agency  saved  $250,000.  In  the  Department  of  Defence, 
return  cn  investment  in  training  wd  the  time  devoted  to  problem  solving 
through  QCs  had  ranged  from  $4  to  $26  for  each  dollar  invested.  Other 
benefits  incltided  such  intangibles  as  better  morale  and  Improved  communication 
between  ledxur  and  management.  Currently  In  the  Austredlan  Army  there  are  QCs 
in  several  engineering  workshops  though  they  are  not  lalaeled  as  such. 
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Sone  one-off  studies  have  collected  data  vthlch  could  be 
Incorporated  Into  ongoing  effectiveness  programmes.  One  such  study  mss  the 
detailed  Investigation  of  the  use  of  Incentives  In  the  U.S.A.F.  vAUch  compared 
a  range  of  non  financially  based  outcomes  and  financially  based  outcomes 
(Pritchard,  De  Leo  and  Von  Bergen,  1976) .  Another  Is  the  development  In  a 
military  environment  of  the  use  of  utility  analysis  (Hunter  and  Schmidt,  1983) 
to  translate  findings  Into  economically  meaning^  terms  (the  standard 
deviation  In  performance  In  dollar  terms) .  The  technique  2q]pears  to  work  with 
selection  Interventions  but  has  not  bs&i  proven  In  other  areas  and  cannot 
atlwaiys  be  replicated  (Eatcai,  Wing  and  Mitchell,  1985). 

Some  mllltairy  programnes  have  started  out  with  a  theoretical  base 
borrowed  from  civilian  eiqierlence  a»l  developed  It  Into  something  uniquely 
military.  Broedllng,  Glthens  and  Riedel  (1977)  developed  a  management 
techniques  Inventory  for  the  U.S.  Navy  based  on  an  Organisation  Development 
(OD)  model.  This  same  GO  model  provided  the  basis  for  the  U.S.  Army 
Organisation  Effectiveness  programme.  In  the  period  1975-1985  this  programme 
trained  more  than  1700  Organisational  Effectiveness  Staff  Officers  to  act  as 
"consultants"  to  general  officers  on  the  use  of  behavioural  science 
techniques.  The  16  we^  training  progranme  (Hayden,  1985)  provided  grounding 
In  basic  systems  models;  organisational  canmunlcatlons;  Information  systems; 
management  skills  and  assessment  and  organisational  systems.  The  U.S.  Army 
experience  In  this  very  ambitious  undertcdelng  and  Its  demise  have  produced 
valiiable  lessons  In  the  Importance  In  this  type  of  progranme  of  malntednlng 
suq^jort  of  the  top  people  In  the  organisation  and  not  allowing  a  progranme  to 
become  too  exclusive  In  Its  eqiproach. 

In  looking  at  progranraes  attegpted  In  military  settings,  and  many  of 
tdilch  were  quite  successful,  the  element  missing  appears  to  be  coordination 
and  cross  fertilisation  of  experience  and  Ideas  even  within  Individual 
military  organisations. 

Effectiveness  Models 

Tuttle  (1983)  presents  a  model  (Figure  2)  to  represent  the 
productivity  management  process.  The  process  has  five  stages  that  are 
conceptually  linked  to  productivity  measurement. 


Figure  2 

Productivity  Mancwement  Process 


Somers,  Locke  and  Tuttle  (1985)  concentrate  on  management  basics 
Including  the  need  for  organisation  direction.  They  define  direction  In  four 
sequential  steps: 
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a.  Define  philosophy  and  organisational  purpose, 

b.  Define  Key  Results  Areas  (KRAs)  for  each  job, 

c.  Define  relevant  performance  Indicators,  and 

d.  Define  specific  goals  for  each  indicator. 

The  present  study  Is  Intended  to  overlay  the  aMareness  anl  analysis 
steps  of  Tuttle's  productivity  management  process  In  the  Somers  et  al  (1985) 
model  modified  to  take  account  of  priorities. 

The  Effect  of  Specific  Manewement  Techniques  on  Productivity. 

Some  studies  (Guzzo  and  Bendy,  1983;  Katzell  et  al,  1977)  seajrched 
the  literature  for  "experiments"  dealing  with  the  effect  of  interventions  or 
techniques  on  productivity.  Other  studies  have  located  at  the  use  of  some 
single  management  technique  In  a  variety  of  situations.  For  exanple, 

Kondrasuk  (1981)  an^aysed  185  studies  of  the  effects  of  Managemmit  By 
Objectives  (MBO).  Broedllng  et  al  (1977)  using  an  OD  model,  looked  at  the 
relationship  between  f^mlllarlty  with  leadership  techniques  and  effectiveness 
In  solving  problems. 

The  currait  study  Investigates  the  relationship  between  familiarity 
with  a  gro«;q>  of  management  techniques,  management  Interventions  and  perceived 
effectiveness.  The  hypothesis  being  tested  Is  that  there  is  a  direct  positive 
relationship  between  familiarity  with  management  techniques,  management 
interventions  and  perceived  effectiveness.  The  management  techniques  chosen 
for  the  survey  questionnaire  were  selected  from  literally  hundreds  of 
techniques  based  on  the  criteria  that  they  were  either  (1)  in  wide  vse,  (2) 
had  made  significant  Impact  In  recent  years  or  (3)  were  representative  of  a 
wide  area  of  techniques.  Some  techniques  that  met  at  least  one  of  the 
criteria  were  deliberately  left  off  the  list.  Operation  Research  was  left  off 
because  the  theory  Is  too  conplex  to  swmarise  and  Cost-benefit  analysis  was 
omitted  because  It  is  the  attitude  and  sqjproach  that  appears  Important  rather 
than  specific  technique. 


Alms 

The  alms  of  the  present  study  were  to: 

a.  Test  the  primary  hypothesis. 

b.  Ose  a  survey  instrument  to  accomplish  the  awareness  and  assessment 
steps  In  Tuttle's  productivity  management  process  and  the  collection 
of  Information  prerequisite  to  determlnli^g  the  organisation  process. 

c.  Analyse  the  effects  of  background  factors  on  perceived 
effectiveness. 

Compare  time  spent  In  long  term  plcmning  with  the  use  of  planning 
techniques. 

e.  Compare  the  perceived  utility  of  management  Interventions  In  this 
stu^  with  the  findings  of  Quzzo  et  al  (1985). 

f.  Develop  a  proposal  which  wcxild  see  the  organisation's  activities 
In  terms  of  a  performance  orientation  based  on  a  process  vdiere  the 
responsible  officer  at  any  level  of  the  organisation  could: 


(1)  Specify  the  KRAs  for  the  unit  or  fonnatlon. 
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(2)  Specify  the  priorities  for  those  KRAs. 

(3)  Specify  how  performance  Is  meastired  (measurement  Indicators). 

(4)  Specify  existing  gap  between  perfonnance  and  desired  outcome, 
and 

(5)  Specify  the  managment  interventions  and  techniques  being  used 
in  a  strategy  to  eliminate  the  gap. 


Method 


Access 


The  researcher  is  employed  as  an  Army  psychologist  (Major)  within 
the  Australian  Army  Psychology  Corps.  This  study  was  cxnplet^  during  two 
years  of  "long  tern  schooling"  sponsored  by  the  Army.  The  research 
constitutes  pairt  of  the  recjuirement  for  the  ctegree  of  Master  of  Arts  in 
i^lled  Psychology.  The  researcher  had  no  ccaastraints  as  to  the  subject 
matter  to  be  researched.  Indeed,  there  was  tx>  recpiixement  for  the  subject 
matter  to  be  related  to  the  Army  at  all. 

Prior  to  the  conduct  of  the  study  an  outline  of  the  proposed  study 
was  submitted  to  the  Australian  Army  Deputy  Chief  of  Personnel,  together  with 
a  recpiest  to  make  use  of  Army  rescurc:es  (Annex  B) .  Qualified  approval  was 
received  (Annex  C)  and  at  a  later  time  the  Deputy  Chief  of  Personnel  provided 
an  madorslng  letter  for  the  survey  questionnaire  (Annex  D) . 

Subjects 


The  pcfMlation  cxmprlsed  1398  officers  in  rank  of  Major  and  498 
offlc:ers  in  the  raidc  of  Lieutenant  Colcanel,  representing  middle  management  in 
the  Australian  Army.  The  sample  of  276  Majors  and  1CX>  Lieutenant  Colonels 
(representing  20>i  of  the  officers  in  each  of  these  ranks)  was  selected  using 
cxmputer  generated  lists  of  randan  nunbers.  The  sanple  was  considered  to  be 
random  except  for  rank.  Geographical  influenc^es  were  not  seen  as  inportant 
because  the  average  Army  officer  changes  location  atxsut  every  two  years. 

Survey  Instrument 

Data  collection  was  accxmpllshed  using  a  cjuestionnaire  which  has  a 
format  and  many  cjuesticns  similar  to  those  used  in  the  Organlsatlcsal 
Assessment  Package  cieveloped  by  HenSrix  and  Halverson  for  the  U.S.A.F.  The 
cpiestlonnaire  (Annex  A)  ccsntalns  22  bac^kground  information  items  and  seven 
sectlcxts  of  attltudlnal  Items.  The  attitudinal  items  are  mostly  seven-point 
Likert  scales,  althcxph  a  few  items  contain  a  zero  point  for  nan-applicable 
responses. 


The  areas  measured  In  the  questionnaire  are  the  job,  one's 
supervisor,  the  organlsatlcmal  climate,  satisfaction  with  a  series  of 
organisatlcxial  factors,  exposure  to  management  interventions  and  specific  ^ 

management  techniques,  and  perceived  effectiveness  of  the  respondent  and  those 
people  he  works  with. 

The  questionnaire  was  designed  primarily  to  allow  a  cxnparison 
between  perceived  effectiveness,  background  factors  and  stated  exposure  to 
management  interventions  and  management  tecbnlques.  ^ 

Procedure 

Satisfactory  access  having  been  obtained,  a  survey  questionnaire 
was  constructed  and  pilot  tested.  Using  a  mailed  questionnaire,  data  were 
collected  on  effectiveness  (perceived),  job  satisfaction,  organisational  ■ 
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cllffiate  and  managemoit  style  (supervision) .  In  addition  data  Mere  collected 
on  managerial  Interventions,  using  Ouzzo  and  Bondy  (1983)  categories,  and 
exposure  to  specific  management  techniques  selected  from  a  wide  range 
available  for  study.  Data  Mere  also  collected  cn  background  information  such 
as  sex,  age,  rank,  corps  and  career  intentions. 

Great  care  ves  taken  to  preserve  the  anonymity  of  the  respondents. 
In  the  pilot  study  IntervleMees  Mere  asked  not  to  ccoplete  the  questionnaire 
section  on  si:^)ervislan.  For  the  main  study  there  Mas  nothing  on  the 
questionnaire  or  answer  sheet  that  v«=ruld  identify  the  respcndent.  Details  of 
procedures  used  in  the  study  ^ure  shown  in  Table  1. 

Table  1 

Details  of  the  Procedure  Used  in  the  Current  Study 


Action  CcBBtent 


1. 

Choice  of  reseaurch  topic 

Mllltrury  related  subject 

2. 

Literature  search 

Including  three  on-line 

3. 

Devel<^ment  of  research  proposal 

Fbr  Army  and  Uhiversity 

4. 

Request  for  use  of  Army  resources 

Subjects,  mailing  lists 

5. 

Approval  granted 

Subject  to  constraints 

6. 

Presentation  of  research  proposcil 

To  miniccnference  (eq:prcived) 

7. 

Development  of  survey  Instrument 

Some  modification  of  previous 

questionnaire 

8. 

Saaple  selected  for  pilot  study 

Stratified  sample 

9. 

Pilot  study  co«xlucted 

Using  InteivieMB 

10. 

Survey  Instrument  modified 

Additions  and  deletions 

11. 

Subjects  selected  for  main  study 

Using  random  nunbers 

12. 

Request  to  Army  for  covering  letter 

De  facto  anoroval  of  survev 

for  questionnaire 

instrument 

13. 

Covering  letter  provided 

14. 

Questionnaire  distributed 

Army  system,  direct  mall 

15. 

Questionnaire  responses  ccnpiled 

16. 

Analyses  of  data 

Factor  analysis,  LISREL 

Pilot  Study 

The  survey  Instnment  was  pilot  tested  using  interviews  with  15 
officers  in  the  rank  of  Major  and  5  officers  in  the  rank  of  Lieutenant  Colonel 
serving  in  the  Melbourne  area.  These  officers  were  nominated  by  the  Staff 
Officer  Military  Secretary  for  Victoria  using  a  stratified  sample  according  to 
rank,  corps  and  sex.  The  officers  involved  in  the  pilot  test  were  excluded 
from  the  main  study. 

Vne  pilot  study  resulted  in  several  changes  being  made  to  the 
survey  instrument.  Among  others,  these  included  details  in  background 
Infotmatlcn  items,  deletion  of  items  considered  to  be  confusing  and  the 
inclusion  of  additional  items  suggested  by  officers  in  the  pilot  study.  The 
questionnaire  used  in  the  pilot  study  had  some  openr-ended  questions.  ^£aIy  of 
these  developed  into  items  in  the  final  questionnaire. 

Measures 


Mille  there  is  no  doubt  that  concrete  measures  of  effectiveness  or 
productivity,  such  as  those  used  by  Guzzo  and  Bondy  (1983)  are  preferable  to 
attltudlnal  measures,  concrete  measures  cannot  be  applied  until  they  have  been 
developed  in  a  particular  context.  In  the  current  study,  attltudlnal  measures 
in  the  fone  of  questionnaire  Section  8  on  perceived  effectiveness  have  been 
used  in  the  absence  of  concrete  measures.  In  Section  8  of  the  questionnaire 
(  respondents  are  asked  about  such  dimensions  of  effectiveness  as  quality. 
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qaantlty,  use  of  resources,  timeliness  and  time  pressures,  managerial 
interpersonal  skills  and  overall  performance. 

Analysis 


The  major  hypothesis  is  that  there  is  a  direct  positive 
relationship  between  exposure  to  managerial  interventions  or  techniques  and 
perceived  effectiveness.  Perceived  effectiveness  as  measured  in  Section  8  of 
the  questionnaire  is  considered  to  be  the  dependent  variable  against  which 
all  other  factors  are  compared  or  correlated. 

The  analysis  will  take  the  following  sequence: 

a.  Reliability  computed  for  questionnaire  items  as  an  initial 
screening.  Items  to  be  deleted  vtere  they  do  not  form  part  of  a 
linear  function  or  vAiere  more  than  20!IS  of  respondents  fail  to  answer 
an  item. 

b.  Recooputatlon  of  reliability  for  questionnaire  sections  after  the 
deletion  of  items. 

c.  Use  of  principal  component  factor  analysis  to  group  measured 
variables  into  homogeneous  subsets  to  facilitate  further  analysis 
and  to  avoid  having  a  variable  for  every  questionnaire  item.  Any 
items  loading  less  than  .5  will  be  ellmimted. 

d.  Variables  for  items  6-15  and  7-5  to  7-7  will  be  computed  using  a  "d" 
statistic.  The  d  statistic  has  its  origins  in  the  work  of  Cohai 
(1969)  and  has  been  used  extensively  by  Guzzo  et  al  (1985) .  It  is 
calculated  using  the  following  formula: 


d=(Xi-5{g)S 


Mhere  }U  and  Xg  are  respectively,  the  means  for  individual  and  groi^ 
respormes  on  a  given  measure  and  S  is  the  group  standard  deviation. 

e.  Use  of  cne  way  Multivariate  Analysis  of  Varicuice  end  Co-variance 
(NANDVA)  on  selected  background  items  and  effectiveness  factors. 

If  the  MANOVA  does  not  produce  significant  differences  among  the 
items,  data  will  be  analysed  as  a  single  sample,  and 

f .  Use  of  maxlmuB-likellhood  analysis  of  structural  equations  using  a 
computer  pi-ogramme  called  Linear  Structural  Relations  (LISREL) . 

LISREL  has  become  comnm  in  texts  (Everltt  and  Dunn,  1983)  and 
journal  articles  (Maruyama  and  McGarvey,  1980) .  With  LISREL,  unlike  multiple 
regression  analysis,  the  assimptlon  of  measurement  without  error  is  not 
necessary,  as  each  of  the  observed  measures  contain  a  residual  which  contains 
both  unique  and  error  variance.  Thus,  measures  no  longer  have  to  be  pure 
indicators  of  theoretical  variables  since  only  the  shared  variance  of  measures 
within  a  dimension  is  extracted.  In  the  current  study  an  empirically  testable 
model  will  be  presented  and  then  its  parameters  estimated  using  LISREL.  The 
BK)del  is  improved  using  the  maxlinian  modification  index  of  the  LISREL  progreanme 
to  add  links.  Links  are  eliminated  when  standard  error  negates  relation¬ 
ships.  Individual  maxiiaim-likelihood  parameter  estimates  will  be  considered 
meaningful  when  coefficients  are  at  least  twice  the  standazd  error.  The 
LISREL  can  be  regarded  as  having  a  measurement  model  which  relates  obeerved 
variables  to  unobserved  variables  and  a  structural  model  which  estimates  the 
interrelations  of  the  unobserved  variables.  The  structural  model  expresses 
eadi  theoretical  dependent  variable  as  a  function  of  the  other  theoretical 
variables. 
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Results 

The  overall  response  rate  for  the  nailed  questionnaire  was  67  K  of 
B  the  san^le  of  officers.  The  total  number  of  quest lontalres  returned  was  253 

or  equivalent  to  13  K  of  the  pc^xilatlon  of  1896  Officers.  This  was  after 
eliminating  11  answer  sheets  coaldered  invalid  because  they  did  not  contain 
«>augh  data  to  xise.  Details  of  responses  received  In  the  main  study  are  set 
out  In  Tables  2,  3  and  4. 

*  Table  2 


Number  of  Restxanses  Received  and  Included  In  the  Study  and  Response  Rate, 
Classified  by  State  or  Territory  (Military  District) 


Location 

Sample 

Respcnses  Received 

Response  Rate  <oer  cent) 

Qld  (IMD) 

69 

36 

52.17 

NSW  (2M3) 

59 

51 

86.44 

Vic  (3MD) 

82 

63 

76.82 

SA  (4MD) 

13 

6 

46.15 

WA  (5M)) 

12 

11 

91.66 

Tas  (6MD) 

2 

2 

100.00 

NT  (7MD) 

5 

2 

40.00 

ACT 

134 

79 

58.95 

Totals 

376 

250 

Table  3 

Nunber  of  Responses  Received  and  Included  In  the  Study  and 
Response  Rate,  Classified  by  Corps 


Corps 

Sample 

Responses  Received 

Response  Rate  (per  cent) 

RAAC 

20 

16 

80.00 

RAA 

32 

23 

71.87 

RAE 

38 

23 

60.52 

RA  Svy 

11 

7 

63.63 

RA  Slgs 

19 

16 

84.21 

RA  Inf 

75 

50 

66.66 

AA  Avn 

12 

5 

41.66 

Aust  Int 

11 

4 

36.36 

RACT 

27 

19 

70.37 

RAAMC 

13 

5 

38.46 

RAADC 

11 

5 

45.45 

RAAOC 

50 

45 

90.00 

RAQ4E 

25 

16 

64.00 

RAABC 

10 

7 

70.00 

AALC 

2 

1 

50.00 

AA  Psych 

1 

0 

00.00 

MOV 

8 

6 

75.00 

AAOC 

4 

2 

50.00 

AABC 

2 

1 

50.00 

RAANC 

4 

1 

25.00 

RAA  Ch  0 

1 

1 

100.00 

Totals 

376 

253 
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■r^le  4 

Niinber  of  Responses  Received  and  Included  In  the  Study  and 
Response  Rate.  Classified  by  Rank  cmd  Sex 


i 

t 

\ 


Population  Saaple  Responses  Response 

Received  Rate  (per  cent) 


Lieutenant  Colonel 

498 

100 

73 

73.00 

Major 

1398 

276 

180 

65.21 

Msde 

1828 

357 

242 

67.78 

Fesmle 

68 

19 

11 

57.89 

Overall,  the  responses  received  were  representative  on  the  basis  of 
rank,  sex  and  geographical  location.  They  were  also  representative  on  the 
basis  of  cotps  with  the  exception  of  the  smller  corps. 

Manaaenent  Interventions 

The  study  has  examined  the  effects  of  management  Interventions  and 
management  techniques  on  perceived  effectiveness.  Respondents  were  asked  to 
Indicate  familiarity  with  11  management  Interventions  on  a  1-7  Likert  scale, 
"i^ipralsal  and  feedback"  was  the  Intervention  respondents  were  most  familiar 
with.  "Plnanclal  compensation"  was  ranked  at  the  bottom  of  the  list 
(table  9). 


Vtwn  respondents  were  asked  vtiich  of  the  11  Interventions  the 
organisation  made  best  use  of,  the  majority  Indicated  "Training  and 
Instruction".  This  Is  not  surprising  considering  the  emphasis  placed  on  this 
Intervention  In  the  Army.  The  qualitative  ranking  of  interventions  is  seen  in 
Table  6.  "Firauiclal  compensation"  was  rated  the  Intervention  "not  well  used" 
by  the  organisation.  "Appraisal  and  feedback"  was  the  Intervention  that 
"received  most  attention"  In  the  respondent's  own  job.  The  respondents  had 
the  "moet  experience"  using  "Training  and  iistructlcn” ,  which  is  consistent 
with  the  "best  used"  result.  The  raidtings  given  "Financial  conpensation"  and 
"Soclotecdmlced  systems"  are  quite  consistent  for  each  of  the  questions.  With 
"Financial  conpensation"  this  may  relate  to  questions  of  constraint.  With 
"Soclotechnlcal  interventions"  It  may  relate  to  definitions  used.  Conplete 
details  of  responses  are  contained  in  Annex  E. 

Performance  Measures 


Respondents  were  asked  to  select  from  a  restricted  list,  a  single 
Indicator  of  unit  perfoimupce.  Re-enllstment  (re  engagenmnts)  rated  the 
highest,  reduction  In  tank  wes  at  the  bottom  of  the  list  (Table  7).  The  I 

purpose  of  the  sespnent  of  the  questionnaire  was  to  determine  whether 
respondents  could  rank  order  an  extremely  liiaited  set  of  measures.  The 
reeults  Indicate  that  re^xndents  had  no  difficulty  In  performii^  this  task. 


a 


a  -  '■*' 


I 
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Table  5 

Respondents'  Familiarity  with  Management  Interventions 


Intervention  Mean 

Appraisal  and  feedback  5.60 
Goal  setting  5.46 
Training  and  Instruction  5.41 
Svqjervlsory  methods  5.30 
Declslcxi  making  methods  5.11 
Work  schedules  4.76 
Organisation  structure  4.39 
Work  redesign  4.34 
Recruitment  and  selection  3.73 
Soclotechnlcal  Interventions  3.66 
Financial  conpensatlon  3.08 


Standard 
Devlationf SD) 

Ranklna 

1.02 

1 

1.05 

2 

1.37 

3 

1.15 

4 

1.31 

5 

1.45 

6 

1.62 

7 

1.67 

8 

1.92 

9 

1.94 

10 

1.67 

11 
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Table  6 

Qualitative  Rankltxi  of  Management  Interventlcans 


1 


Interventions 
Training  and  Instruction 
Appraisal  and  feedback 
Supervisory  methods 
Goal  setting 
Organisation  structure 
Recruitment  and  selection 
Work  redesign 
Work  schedules 
Decision  naklng 
Soclotechnlcal  Interventions 
Financial  conipensatlan 


Rankings 
A  B 

1  10 

2/3  3 

2/3  9 

4  5 

5  6 

6  8 

7  4 

a  11 

9  7 

10  2 

11  1 


C  D 

4  1 

1  2 

3  3 

2  4 

7  6 

9  8/9/10 

10  8/9/10 

5  8/9/10 

6  5 

8  7 

11  11 


1 


A  Intervention  the  organisation  "makes  the  best  use  of" 

B  Intervention  "not  well  \ised"  by  the  organisation. 

C  Intervention  that  "receives  most  attention"  In  own  job. 
D  Intervention  respondent  "has  most  e^^rlence  In  using" 


> 
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Table  7 

"Best"  Single  Indicator  of  General  unit  Performance 


Indicator 

Freouenev 

Per  cent 

Ranking 

Re-enl  istments 

68 

26.9 

1 

Posting  c^licatloi 

67 

26.5 

2 

MllitcttY  civil  offices 

32 

12.6 

3 

Discharge  application 

30 

11.9 

4 

Course  passes 

25 

9.9 

5 

Absenteeism  without  leave 

17 

6.7 

6 

Kamlngs  for  discharge 

5 

2.0 

7 

Reductlorts  in  rank 

0 

0 

8 

Management  Techniques 

Respcxidents  had  been  aslced  to  express  familiarity  with  a  list  of 
seven  management  techniques  (Table  8)  and  to  indicate  on  the  questionnaire 
Itself  viAUch  of  the  seven  techniques  that  they  had  "made  seme  use  of" 

(Table  9) .  The  results  go  against  any  Idea  that  Army  "managers"  do  not  keep 
\?)  with  oirrent  management  practices.  More  than  63)ls  of  the  respondents  had 
made  some  use  of  Management  by  Objectives  and  almost  half  had  made  some  use  of 
some  form  of  Network  Anedysis.  More  than  a  third  had  made  some  \jse  of 
electronic  spreadsheets,  v^ch  is  some  indication  of  the  growing  role  of 
computers. 

I  Table  8 

I 

1  Familiarity  with  Management  Techniques 


Mean  SD 

Number  of  Management  Techniques  the  Respondent: 


Had  heard  of 

4.174 

1.934 

Had  observed  being  used 

2.885 

1.724 

Received  Army  sponsored  training  in 

1.767 

1.891 

Received  Non  Army  tralnli^  in 

.928 

1.644 

Had  made  some  use  of 

2.560 

1.653 

Had  made  extensive  use  of 

1.359 

1.290 

Had  made  dally  use  of 

.810 

1.050 

Technique 

Per  cent 

Network  Analysis  (PQtT,  CFM) 

110 

43.47 

Management  by  objectives 

161 

63.63 

Value  analysis 

62 

24.50 

Quality  circles 

64 

24.29 

Electronic  spreadsheets 

86 

33.99 

Organisation  development 

34 

13.43 

Divergent  problem  solving 

42 

16.60 

Ose  of  Ccmputers 

The  role  of  ccnpiters  was  further  seen  vAien  respondents  were  asked  how 
often  they  made  use  of  Anny  EDP  facilities.  Only  2A%  indicated  "never"  and 
23%  indicated  "dally.”  The  cooplete  results  are  contained  in  Ihble  10. 


Table  10 

Frequency  of  Use  of  Army  Conputer  Pacilltles 


Frequency 

Per  cent 

Never 

61 

24.1 

Rarely 

41 

16.2 

Occasionally 

57 

22.5 

Dally 

59 

23.3 

Constantly 

32 

12.6 

Relevance  of  Civilian  Management  Ewaerience 

It  is  sonetiines  assvaned  that  Anny  "managers"  see  themselves  as 
different  front  managers  in  the  general  ccmmunity  because  their  goals  are  quite 
different.  Nhen  survey  respondents  were  asked  to  rate  on  a  1-7  Likert  sotle 
the  relevance  of  managenent  escperience  and  management  techniques  from  the 
general  conmunlty,  they  were  seen  as  quite  relevant  (Figure  3).  Wien  asked  to 
list  the  biggest  single  dlfferoice  between  tasks  of  civilian  mara^rs  and  Army 
"managers",  more  than  a  third  choose  profit  motive  and  almost  5%  saw  no 
significant  differences  (Tttle  ll). 


1 


1 


Perswaiel  Retention 


Of  particular  Interest  to  military  organisations  in  Australia  in 
recent  times  is  the  question  of  personnel  retention.  (<hen  the  respondents  in 
the  study  (June,  1987)  v«ere  asked  about  their  career  intentions,  only  about 
SOU  indicated  their  intention  to  stay.  A  quite  large  (37.9)  percentage  of 
respondents  said  they  were  "qpai  to  offers”.  It  is  interesting  to  note  for 
the  larger  corps  that  only  32iK  of  Infantry  Officers  saw  themselves  as  "open  to 
offers"  vdiereas  SllS  of  Ordnance  Corps  Officers  put  themselves  into  that 
category.  A  crosstabulation  of  career  intentions  and  probabilities  for  those 
intentl(»is  is  contained  in  Table  12.  A  further  con^iarison  of  career 
Intentions  by  corps  is  contained  in  hiwex  F. 


Table  12 

Crosstabulation  of  Career  Intentions  and  Probability 


Career  Intentions 

Will 

Continue 

50 

Retire 

2 

Resign 

14 

Open  to  offers 

11 

Column  Total 

77 

Percent 

30.4 

Probability 


Likely 

May 

Undecided 

Row  total 

70 

4 

4 

128 

(50.6SS) 

1 

0 

0 

3 

(1.2%) 

11 

1 

0 

26 

(10.3%) 

30 

34 

21 

96 

(37.9%) 

112 

39 

25 

253 

44.3 

15.4 

9.9 

(100.0%) 

Job  Mobility 

Of  the  officers  in  the  study  (avercige  age  37,  minimun  age  29) , 
almost  half  (47. 6K)  had  made  eight  or  more  geographical  moves  in  their  career 
(almost  9K  had  made  more  than  12) .  Almost  42X  had  held  more  than  10  job 
appointments  in  their  careers  and  close  to  half  (46.3X)  had  been  in  their 
present  job  six  months  or  less.  This  is  not  \siexpected  given  the  original 
assumption  that  officers  change  jobs  on  an  average  of  every  tv«3  years.  Table 
13  contains  a  crosstabulation  of  time  in  job  by  current  posting  location. 


Croestabiilation  of  Poetlna  Location  hv  Time  In  Present  Job 


Time  in  present  lob 


Less  than 

More 

than 

Row 

Poscing  Iiocatlon 

3  months 

3—6 

7-9 

10-12 

13-18 

19-24 

2  vrs 

Total 

1  MD 

(OLD) 

- 

17 

2 

1 

13 

1 

3 

37 

14. 8X 

2  MD 

(NSW) 

1 

18 

2 

1 

15 

2 

11 

50 

20.0% 

3  Ml 

(VIC) 

3 

31 

“  • 

2 

18 

3 

6 

63 

25.2% 

4  MD 

(SA) 

3 

* 

2 

*“ 

1 

6 

2.4% 

5  MD 

(MA) 

5 

5 

1 

11 

4.4% 

6  Ml 

(TAS) 

““ 

2 

“ 

2 

.8% 

7  MD 

(NT) 

2 

— 

2 

.8% 

Canberra 

1 

36 

3 

7 

22 

4 

6 

79 

31.6% 

Colusn  Total 

5 

110 

7 

11 

79 

10 

28 

250 

Percent 

2.0 

44.0 

2.8 

4.4 

31.6 

4.0 

11.2 

100.0% 

Long  Term  Planning  and  Management  Techniques 

Efforts  to  find  a  relationship  between  time  spent  in  long  term 
planning  and  the  number  of  managenent  techniques  respondents  had  "made  use  of" 
did  not  produce  a  significant  correlation. 

Formation  of  the  Scales 


As  an  initial  screening,  Crtmbach  alphas  were  conputed  for  all 
questionnaire  items  (except  the  sections  on  background,  manageinent 
interventlcns  and  management  techniques) .  This  led  to  the  deletion  of  items 
2-5,  2-12  and  2-17  in  the  Job  Inveitory  section,  item  3-3  in  the  Job 
Satisfaction  section,  it«ns  4-16  and  4-23  in  the  Supervision/Management 
section,  items  5-9  and  5-15  in  the  Organisation  Climate  section  and  item  8-12 
in  the  Perceived  Effectiveness  section.  In  addition,  item  8-15  was  deleted 
because  more  than  20%  of  respondents  failed  to  answer  the  item.  Reliabilities 
were  recalculated  after  the  deleticxi  of  items  and  final  reliabilities  for  the 
sections  were; 


a. 

Job  Inventory 

.88 

(21 

items) ; 

b. 

Job  Satisfaction 

.84 

(11 

items) ; 

c. 

Supervision/Management 

.93 

(25 

items) ; 

d. 

Organisation  Climate 

.79 

(13 

items) ; 

e. 


Perceived  Effectivaiess  .83  (  20  items). 
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It  Is  acknowledged  that  high  reliability  does  not  preclude  existence 
of  a  inultifactor  structure  (Green,  Lissitz  and  Mulaik,  1977). 

An  orthogonally  rotated  priix;ipal  components  factor  analysis  was 
performed  on  all  questionnaire  Items  except  for  sections  containing  the  items 
on  background,  management  interventions  and  siicurtagement  techniques.  The  factor 
analysis  was  used  only  as  a  guide  to  grouping  variables  into  hcmogeneous 
subsets  that  could  be  used  in  a  model  (rather  than  having  a  variable  for  each 
questionnaire  item).  Itans  loading  less  than  .5  were  eliminated  from 
Inclusioi  in  completed  factors.  A  sunmary  of  factor  analysis  results  is 
contained  in  Table  15  (page  26) .  F^rtor  loadings  for  all  items  are  ccxitained 
in  Annex  G. 

A  one  way  MANOVA  was  performed  on  selected  background  items  (rank, 
career  division  and  attendance  at  Staff  College)  with  effectlvoiess  factors 
(component  performance,  imit  solidarity,  resource  shortfalls,  management 
ejqiertlse  and  quality  and  quantity  of  output) .  The  MANOVA  did  not  produce  any 
significant  differences  among  background  items  and  accordingly  the  data  were 
analysed  as  a  single  sample.  Since  the  responses  did  not  vary  it  was 
considered  appropriate  to  treat  the  data  as  a  single  set  fitting  a  LISREL 
model  to  the  data. 

Develocment  of  the  LISREL  Model 

The  predicted  model  is  presented  in  Figure  4  (page  25) .  Its  parameters 
have  been  estimated  using  the  LISREL  model.  The  model  was  Improved  using  the 
maximum  modification  index  of  the  LISREL  programme  to  add  links.  Links  were 
also  eliminated  vdiere  the  standard  error  negated  relationships.  The  objective 
was  to  get  the  best  fit  possible  without  "overflt".  Development  of  the  final 
model  is  summarised  in  Table  14. 


Table  14 

Development  of  Final  LISRHt-  Mndel 


Step 

Chanoe 

Goodness 
of  fit 

Adi  ooodness 
of  fit 

RMS 

Chi  so. 

df 

1 

E>redlcted  model 

.680 

.605 

.244 

1178.26 

187 

2 

Add  job  satisfaction- 
job  Invaitory 

,74l 

.680 

.222 

954.43 

188 

3 

Add  svpervlslcn- 
organlzatlon  climate 

.794 

.744 

.182 

750.43 

186 

4 

Add  pride  in  organlzatlcnr 
job  inventory 

.802 

.753 

.166 

688.33 

185 

5 

Delete  supervision- 
effectiveness 

803 

.755 

.166 

688.60 

186 

6 

Delete  job  inventory- 
effectiveness 

.801 

.754 

.167 

696.66 

187 
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Figure  4 

Tbe  Predicted  Model 


CPESF 

USOL 


SRES 

C»NOF 

TUQO 


PORG  Pride  in  organisation 

CGLIM  General  organisation  climate 

ORGS  Organisation  strengths 

M40RK  Meaningful /responsible  vrork 

FRH)A  Freedom/autononiy 

PGOAL  Performance  goals 

PRES  Resources 

CDEV  Career  development 

MSAT  Job  satisfaction 

CSAT  Contributians  to  satisfaction 

BASF  Assistance  and  feedback  from  imnediate  superior 

PLUS  Strengths  of  immediate  superior 

BREL  Relationship  with  immediate  siqserior 

BRES  Respect  of  immediate  sc^rior 

AVFAM  Familiarity  with  management  interventions 

AVTEC  Use  of  management  techniques 

CPERF  Component  perfoimance 

USOL  unit  solidarity 

SRES  Resource  shortfalls 

CONOF  Management  e>q)ertlse 

TOQO  Quantity  and  quality  of  outpit 
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Table  15 

Factor  Analysis  by  Section  ^Rotated  Factors) 


Section/Factor 

K  Total  Varicince 

HicAiest 

Loadina 

Total 

items 

Loadlnos 
above  .50 

Job  Inventory 

Meaningful  work 

33.5 

.85 

11 

6 

Freedom/Autonony 

11.1 

.88 

8 

4 

Task  accomplishment 

7.9 

.75 

9 

4 

Resources 

6.4 

.87 

4 

3 

Ceureer  develcpnent 

4.7 

63.6 

.79 

5 

3 

Job  Satisfaction 

Job  related  satisfaction 

38.1 

.87 

8 

6 

Contributions  to  satisfaction  10.1 

48.2 

.68 

6 

4 

Suservision/Manaaesnent 

Inmediate  Siflierlor  (IS) 
Assistance/Feedback 

38.8 

.81 

12 

9 

IS  Strengths 

10.7 

.80 

8 

7 

Relatlcsis  with  IS 

8.0 

.78 

7 

6 

IS  Recognition 

4.5 

62.0 

.82 

7 

3 

Oroanisation  Climate 

Pride  in  organisation 

30,6 

.81 

7 

3 

General  climate 

13.2 

.76 

6 

4 

Organisation  strengths 

8.1 

51.9 

.76 

6 

4 

Effectiveness 

Uhit  perfornence 

28.6 

.74 

11 

7 

Unit  solidarity 

8.3 

.77 

5 

2 

Management  and  expertise 

6.4 

.74 

4 

2 

Quantity  and  quality 
of  output. 

5.4 

.75 

4 

2 

Resource  shortfalls 

7.2 

55.9 
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The  Mectsurement  Model 

I  '  -  .1  - 

Tlie  eqjloratory  factor  analysis  that  was  used  to  specify,  a  priori, 
the  relations  between  measures  and  factors  was  confirmed  in  the  final  LISREL 
model  (Figure  5)  by  the  fit  achieved  between  observed  measures  and  independent 
and  dependent  latent  (unobserved)  variables  (IX,  LY) .  Table  16  sets  out  the 
variables  in  the  current  study. 


Table  16 

Variables  Used  in  the  LISREL  Model 


Independent  latent  variables: 

Organisation  climate  (PORG,  GCLIM,  ORBS) 

Job  Inventory  (hWORK,  FREDA,  PQQAL,  PRES,  CDEV) 

Job  satisfaction  (WSAT,  CSAT) 

Supervision/management  (BASF,  PLUS,  BREL,  BRES) 
Familiarity  with  managem^t  interventions 
Use  of  management  techniques 
Dependent  latent  variables: 

Perceived  effectiveness  (C3>ERP,  USOL,  SRES,  CONOF,  TUQO) 


The  Structural  Model 

The  unobserved  variables  having  been  defined,  the  final  LISREL 
model  (Figure  5)  has  estimated  their  interrelations.  When  conpared  to  the 
predicted  model  (Figure  4)  it  shows  familiarity  with  management  interventions 
to  be  correlated  with  perceived  effectiveness  (though  observed  measures  only 
accounted  for  46*  of  the  variance  for  perceived  effectiveness)  and  a  stronger 
correlation  between  familicu’ity  with  management  interventions  and  use  of 
management  techniques.  Organisation  climate  and  job  satisfaction  are  shown  to 
be  related  to  perceived  effectiveness.  Supervision/management  and  job 
inventory  do  not  directly  affect  perceived  effectiveness  as  predicted,  but 
affect  it  indirectly  through  organisation  climate  and  job  satisfaction, 
respectively.  The  relationship  of  job  satisfaction  to  effectiveness  with  this 
particular  population  seems  inconsistent  with  previous  studies  (Locke,  1976) 
using  more  general  peculations.  It  must  be  noted  that  it  is  inpossible  to  get 
a  {Mre  measure  of  job  satlsfactic^.  The  very  strong  correlation  between  job 
inventory  and  job  satisfaction  suggests  that  a  change  in  the  theoretical  model 
combining  the  two  could  lead  to  a  better  overall  model. 
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Flgure  5 

Final  Maxlamn  Lilcellhood  (LISREL)  Madel 


Goodness  of  fit  = 

Adj  goodness  of  fit  = 
Residuals  = 

Chi  Sq  > 


BASF  (.058) 
FLOS  (.060) 
BREL  (.056) 
BRES  (.060) 


WKRK  (.049) 
FREDA  (.059) 
PGQAL  (.051) 
PRES  (.065) 
CDEV  (.059) 


.057) 


.801 

.754 

.167 

696.66 


t 


(187  df)  • 


Note.  Figures  in  brackets  are  standard  error.  Individual  lnaxi]nu^^- 
llkellhood  parameter  estimates  are  considered  meaningful  vdiere  they  are  at 
least  twice  the  standard  error-  Figures  in  squares  are  percentage  of  variance 
accounted  for  by  factors. 
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Dlscussion 


Main  Results 


11)0  najor  findings  of  the  study  were  as  follows: 

a.  A  moderately  positive  relationship  was  found  between  a  set  of  11 
management  Interventions  and  perceived  effectiveness.  This  result 
Is  qualified  by  the  variance  accounted  for  with  perceived 
effectiveness . 

b.  A  strexiger  correlation  was  found  between  familiarity  with  11 
management  Interventions  and  familiarity  with  seven  management 
techniques. 

c.  A  moderate  relationship  was  found  between  Job  satisfaction  and 
perceived  effectiveness. 

d.  Officers  In  the  sanqsle  were  much  more  familiar  with  management 
techniques  from  the  general  ccnnunlty  than  would  have  been  e3q>ected. 

e.  Management  techniques  and  experience  from  the  general  ccmnunlty  were 
seen  as  much  more  relevant  by  the  officers  In  the  study  than  would 
have  beoi  e:q)ected. 

f .  Familiarity  with,  and  frequent  \]se  of,  computer  systems  was  reported 
by  the  majority  of  officers  In  the  8aiiq>le. 

g.  Only  half  of  the  respondents  had  definite  plans  to  remain  in  the 
Army. 

h.  Use  of  financial  Incentives  was  seen  oveivhelmlngly  ee  the 
management  intervention  not  well  used  by  the  total  organisation, 
receiving  the  least  attention  on  the  jt  and  the  intervention 
respondents  had  used  least,  and 

1.  No  relationship  was  found  to  exist  between  time  spent  in  long  term 

planning  and  familiarity  with  a  list  of  seven  management  techniques. 

Shortcomings  and  Qualifications  of  Results 

Several  quallflcatl<x»  apply  to  the  results  of  the  study. 

Scope  of  the  Study.  The  study  was  restricted  to  a  population  which 
was  seen  to  represent  "middle  management"  in  the  Australian  Army.  As  such  the 
study  represents  an  effort  to  gauge  the  middle  manager's  perception  of 
effectiveness  In  the  total  organisation  and  its  ccnponents  and  to  place  these 
perceptions  In  an  overall  model  of  organisational  effectiveness. 

Validity  and  Reliability  of  Measures.  Attltudlnal  measures  were 
used.  Perceived  effectiveness  In  particular  was  used  as  a  depenlent  variable 
in  the  absence  of  concrete  measures.  The  measure  sqjpears  to  have  both  content 
and  construct  validity  on  the  basis  that  the  concept  of  perceived 
effectiveness  was  defined,  thcugh  measured  variables  failed  to  account  for 
much  of  the  variance  with  perceived  effectiveness.  All  of  the  Individual 
questionnaire  sections  demonstrated  high  reliabilities. 

Ccaparlsone  with  Prevlons  Studies.  Because  of  the  specific  natiue 
of  the  population  used,  and  the  use  of  attltudlnal  measures,  direct  conparison 
with  previous  studies  is  difficult.  It  is  worth  noting  that  the  management 
interventions  Quzzo,  Jette  and  Katzell  (1985)  found  to  be  the  most  powerful  in 
productivity  progranmes  (training,  goal  setting)  were  also  the  interventions 


-30- 


that  Azsy  Officers  were  most  familiar  with.  In  ccntarlson,  the  only 
Intervention  that  received  more  attention  by  respondents  was  "appraisal  and 
feedbadc";  the  Interventions  that  received  substantially  less  were  "financial 
coaf)ersatlon"  and  "use  of  soclotecdmlcal  systems”. 

Implications  of  the  Study 

The  results  of  the  study  have  Ispllcatlons  for  general  management 
practices  and  the  training  of  officers  In  the  Australian  Army.  Hopefully,  the 
study  has  taken  the  Initial  steps  that  will  make  the  point  that  there  needs  to 
be  an  aMareness  of  organlsatlcxial  effectiveness  In  the  organisation. 
Additionally,  the  study  has  given  seme  idea  of  the  management  resources 
available  within  the  organisation. 

The  representative  sample  of  middle  management  Australian  Army 
officers  In  the  study  perceived  themselves,  the  total  organisation  and  Its 
coeponent  parts  or  units  as  being  basically  effective.  The  question  then 
becomes:  How  do  we  make  the  overall  cs<ganl8ation  even  more  effective  by 
making  Its  coipcnent  parts  more  effective?  The  problem  Is  not  how  we  make  an 
Ineffective  organisation  effective,  it  is  how  do  we  make  an  effective 
organisation  even  more  effective? 

In  the  case  of  military  organlsaticns,  there  Is  the  experience  of 
other  sucdi  organisations  that  can  be  of  benefit,  even  In  those  instances  vdiere 
effectlvmwss  efforts  have  not  been  toteQly  successful.  A  search  of  the 
literature  on  organisational  effectiveness  In  military  organisations  Indicated 
that  Individual  services  have  employed  a  variety  of  approaches  including 
Organisational  Development  (U.S.  Army),  Management  by  Objectives  (U.S.A.F.), 
and  an  eclectic  approach  (U.S.  Navy).  Methods  that  appear  to  have  the  most 
tisefulness  can  be  grouped  under  the  rubric  of  "Performance  Orientation"  - 
approaches  that  stress  the  specification  and  measurement  of  perfonnance. 

These  would  include  progranmes  that  use  "the  Rational  Manager”  model  (Kepner 
and  Tregoe,  1969)  as  used  with  the  Australian  Anay  training  systan;  the  Hunter 
and  Schmidt  (1983)  model,  using  a  standard  deviation  of  job  performance  In 
dollar  tents  (and  tdtlch  appears  to  work  at  least  in  the  area  of  selection) ; 
and  more  particularly  the  proceduies  of  Tutt.le  and  Weaver  (1986)  derived  from 
a  Management  by  Objectives  model  and  based  on  the  development  of  suitable 
measurement  Indicators. 

Perfonance  Orientation  Is  not  new  to  the  Australian  Army  at  the 
level  of  the  Individual.  The  Army  tiainlng  system  is  based  on  individuals 
attaining  objectives:  the  physical  training  progranmes  and  the  tests  of 
elementary  training  programne  both  involve  setting  standards  and  measuring 
performance  against  the  atandards.  The  personnel  eppralsal  system  is  based  cn 
similar  principles.  Those  same  principles  are  still  being  discussed,  but  at 
the  level  of  the  overall  organlsaticxi  and  Its  cenponents  or  units. 

De^lte  their  usefulness,  Perfonnance  Orientation  approaches  until 
now  have  only  taken  the  practltloier  to  the  point  of  measuring  the  gap  between 
targeted  perfonnance  and  actual  perfonnance.  They  do  not  address  ways  of 
reducing  or  eliminating  the  gap  and  they  do  not  make  use  of  the  broad  range  of 
problem  solving  and  decision  making  techniques  available.  In  addition,  they 
do  not  tate  ad^tage  of  the  significant  research  of  Ouzzo  et  al  (1985)  on 
management  Interventions. 

A  Propoaed  Operational  Model 

A  proposed  model  Is  specified  at  the  organisational  conponent  level 
In  Table  17  which  combines  the  current  most  sophisticated  approach  to  effect¬ 
iveness  isprovements  (Tuttls  and  Weaver,  1986)  with  the  use  of  management 
interventions  and  problem  solving  processes.  Training  in  problem  solvii^  and 
\ise  of  management  interventions  Is  Inhsrent  In  the  proposed  model.  Figure  6 
shows  a  way  of  kseplng  track  of  perfoxnancs  over  time  for  a  single  key  result 
area. 
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Action 


Source 
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AMareness: 

Collection  of  data 

2 

Survey 

Analysis: 

Analysis  of  data 

2 

Optional 

Planning: 

Define  philos<^>hy/Org  parpose 

1  — 

1 

Define  KRAs  for  each  function 

1 

1 

1 

1  Ncmlnal 

Define  priorities  for  KRAs 

2 

1 - 

1  Groi^ 

Define  relevant  measurement/ 
performance  Indicators 

1 

1 

1 

Define  specific  goals  for  each 
Indicators 

1  — 

1 

loplementatlon: 

Convert  plans  to  actions 

2 

Evaluation: 

Measure  gap  between  performance 
and  goals 

1 

Problem  solving: 

Structuring  the  problem 

Choice  of  relevant  management 
Interventlon(s) 

3 

Choice  of  man8gement  techniques 

4 

Use  of  dlverg«it  problem  solving 

4 

Re-evaluation  and. 

if  necessary,  return  to  previous  stages 

Sources: 

1.  Scners,  Locke  and  Tuttle  (1985/86) 

2.  Tuttle  (1983) 

3.  Guzzo  and  Bandy  (1983) 

4.  Current  Study 
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Flgure  6 

Oblectlves  Matrix 


I  K1U  Ho. I  Xdeouote  Ho,  Enainca  to  Meet  Wiaaion  ftequirawento 


12  3  4  5 


Implementation  of  the  model.  Several  approaches  could  be  taken  in 
Inplementlng  the  proposed  operating  model.  The  emphasis  should  be  on  1 

assessing  the  impact  of  the  actions  taken.  This  suggests  the  following  plan: 

a.  Arrangements  are  made  for  an  officer  conversant  with  organisational 
assessment  and  problem  solving  processes  to  observe  the  U.S.A.F. 
programne  in  opieratlon. 

X 

b.  Modification  of  U.S.A.F.  programme  for  use  with  the  Australian  Army. 

c.  Development  of  a  problem  solving  training  package  to  be  used  in 
conjunction  with  the  effectiveness  programme. 


) 


d.  Implementation  of  the  combined  progrannne  on  a  volunteuiV  unit  by 
unit  basis  with  continued  assessment  of  Inpact,  and 

e.  Detailed  review  of  the  programme  eifter  a  period  of  18  nmths. 


Other  Relevant  Items  In  the  Study  for  Further  Research/Develoianent 

It  became  apparent  In  the  pilot  study  that  QCs  are  used  In  the  Array 
(but  not  with  that  label).  In  particular,  this  ^iplles  In  engineering 
workshops.  This  was  confirmed  to  seme  degree  In  the  main  study  where  more 
than  24!k  of  respondents  Indicated  that  they  had  made  seme  use  of  QCs.  The 
success  or  otherwise  of  these  procedures  deserves  seme  form  of  assessment  with 
a  view  to  Improving  their  use  or  generalising  their  \ise  to  other  components  of 
the  organisation.  In  considering  any  Individual  technique  (be  it  QCs  or 
something  else)  the  question  Is  not  vhether  the  technique  is  fashionable,  but 
rather  If  It  produces  desired  results. 

The  LISREL  structural  model  indicated  a  relationship  between  job 
satisfaction  and  perceived  effectiveness.  Although  It  was  beyond  the  scope  of 
the  current  study  to  follow  this  relationship  It  could  provide  the  basis 
for  a  follow-t^j  study. 

The  Inability  of  measured  variables  to  explain  a  larger  percentage 
of  the  variance  for  perceived  effectiveness  suggests  that  further  work  is 
required  on  developing  measures  of  perceived  effectiveness. 

Management  and  Leadership 

This  study  has  not  been  concerned  with  leadership.  It  has  looked 
at  the  effect  of  management  interventions  and  management  techniques  on 
organisational  effectlvenes.  It  Is  difficult  to  discuss  management  in 
isolation,  particularly  In  a  military  setting.  All  military  officers 
e:q)erlence  an  intense  socialisation  process  where  principles  of  leadership  are 
ccxtstantly  stressed.  "Management"  cB  a  term  Is  used  Infrequently.  One 
result  of  this  Is  that  management  auid  leadership  tend  to  be  confused.  An 
example  of  this  is  a  respendent  In  the  current  study  stating  that  he  did  not 
manage,  he  connended.  It  Is  widely  accepted  (Somers,  Locke  and  Tuttle,  1985/ 
1986)  that  it  Is  Inpossible  to  be  a  good  leader  without  being  a  good  manager. 
Researchers  In  the  field  would  argue  that  the  officer  vho  mismanages  the 
careers  of  his  soldiers  cannot  be  a  good  leader.  While  there  Is  no  substitute 
for  the  principles  of  good  leadership  and  good  managanent,  organisational 
effectiveness  erodes  rapidly  If  these  principles  became  cliches  rather  than 
being  reflected  In  actions.  There  is  a  difference  between  perceived 
effectiveness  and  measured  effectiveness.  Mien  effectiveness  Improvement 
procedures  are  Implemented,  stakes  holders  in  the  organisation  are  conmltted 
to  actions  and  the  measurement  of  actual  outcomes.  Measured  achievement 
becomes  the  focus  of  attention,  thus  reducing  reliance  on  subjective 
perc^tlons  about  how  well  the  organisation  or  organisational  component  Is 
performing. 
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m€X  A 


This  questionnaire  represents  an  effort  to  gather  data  for 
research  into  organisational  effectiveness  in  military  organisations.  The 
intention  is  that  the  data  collected  could  be  used  when  decisions  are  made 
concerning  managerial  training  for  Officers  and  when  considering  the 
relevcince  of  specific  managerial  techniques  and  interventions. 

Army  Officers  in  the  worn  rank  of  Major  and  Lieutenant  Colonel 
(representing  middle  management)  are  being  surveyed.  Great  care  has  been 
taken  to  ensure  total  anonymity  and  confidentiality.  You  have  been  selected 
as  a  respondent  at  random  by  using  a  set  of  random  numbers.  When  the 
questionnaire  and  answer  sheet  are  returned  to  the  Military  Secretary  there 
will  be  nothing  to  link  them  to  you.  Despite  this,  completion  of  the 
questionnaire,  or  any  part  of  it,  is  completely  voluntary. 


Instructions 

t.  You  should  put  your  answers  on  the  separate  answer  sheet  provided. 

Item  numbers  are  listed  by  section  and  item.  To  answer  Item  1-1  you  would 
put  a  1  on  the  answer  sheet  if  your  worn  rank  is  Major  and  a  2  if  your  worn 
rank  is  Lieutenant  Colonel. 

Item  Mo _  Answer 


Code 


2.  The  right  hand  column  on  the  answer  sheet  marked  "Code"  can  be 
ig.norsd,  it  is  only  an  aid  to  formating  the  data  for  the  computer. 

3.  On  completion  of  the  questionnaire  please  return  the  answer  sheet 
and  questionnaire  to: 

Office  of  the  Military  Secretary 
Department  of  Defence  (Army) 

Russell  Offices 
CANBERRA  ACT  2600 


A-2 


SECTIOH  1 

BACKGBOOND  IWPOHHATIOH 


1-1  Please  indicate  your  worn  rank. 

1 .  Major  2.  Lieutenant  Colonel 


1-2 

What 

is  your  age? 

(Last  Birthday!, 

1-3 

Your 

career  division  is; 

1 . 

GSO  2. 

PSO  3.  SSO 

1-4 

Your 

sex  is: 

1 . 

Male  2. 

Female 

-5  Your 

allotted  Corps 

is: 

01 . 

RAAC 

10. 

RAAMC 

02. 

RAA 

11. 

RAADC 

03. 

RAE 

12. 

RAAOC 

04. 

RA  Svy 

13. 

RAEME 

05. 

RA  Sigs 

14. 

RAAEC 

06. 

RA  Inf 

15. 

AALC 

07. 

AA  Avn 

16. 

AA  Psych 

08. 

Aust  Int 

17. 

RACMP 

09. 

RACT 

18. 

AACC 

1-6  Your  highest  level  of  education  is: 

1.  Higher  degree  (Masters  or  PhD) 

2 .  Honours  degree 

3.  Graduate  diploma 

4.  Bachelor's  degree 

5.  Partly  completed  degree  or  diploma 

6.  Post  secondary  or  technical  college  certificate 

7 .  Higher  School  Certificate  or  Matriculation 

8.  Education  below  HSC 


1-7  You  have  passed  Staff  College  (any) 

1.  Yes.  2.  No 


How  many  military  members  do  you  directly  supervise 
(Write  PR  19's  and  PH  66's  on)? 


1 . 

None 

5. 

9  to  12 

2. 

1  to 

2 

6. 

13  to  20 

3. 

3  to 

5 

7- 

21  or  more 

A. 

6  to 

8 

Does 

your 

immediate  superior 

‘  write  your 

1 . 

Yes 

2.  No 

Which  of  the  following  best  describes  your  career  intentions? 

1 .  To  continue  in  the  Army 

2.  To  retire  in  the  next  12  months 

3.  To  resign  in  the  next  12  months 


What  is  the  probability  associated  with  the  previous  answer? 


1 .  Will  happen 

2.  Most  likely  to  happen 

3.  May  happen 
A.  Undecided 


1-12  Where  did  you  complete  your 

officer  training? 

1  . 

RMC  Duntroon 

A. 

In-service  Commission 

2. 

OCS  Portsea 

5. 

Direct  Appointment 

3. 

OTU  Scheyville 

6. 

Other 

1-13  Are 

you  on  a  short 

service 

commission? 

1 . 

Yes  2. 

No 

Indicate  the  major  employment  area  you  have  spent  time  in 
as  an  Army  Officer: 

1.  Materiel/Project  Management 

2.  Personnel/Manpower 

3.  Logistics 

A.  Training/Instructional 

5.  Operations 

6.  Command/Regiraental 

7.  Other 
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1-15  What  is  the  major  emphasis  of  your  current  posting? 

1 .  Materiel/Project  Management 

2.  Personnel/Manpower 

3.  Logistics 

4.  Training/Instructional 

5 .  Operations 

6.  Command/Regimental 

7.  Other _ _ 


1-16  What  is  the  location  of  your  current  posting? 


1 . 

Canberra 

5. 

4MD 

2. 

1MD 

6. 

5MD 

3. 

2MD 

7. 

6MD 

4. 

3MD 

8. 

7MD 

1-17  How  many  postings  (geographical  moves)  have  you  had  since 
being  commissioned? 

1 .  Less  than  4 

2.  4-8 

3.  More  than  8. 


1-18  How  many  posted  Job  appointments  have  you  had  since  being 
commissioned? 

1 .  Less  than  5 

2.  5-10 

3.  More  than  10 


1-19  How  long  have  you  been  in  your  present  job? 

1 .  Less  than  3  months 

2.  3-6  months 

3.  7-9  months 

4.  10-12  months 

5.  13-18  months 

6.  19-24  months 

7.  More  than  2  years 


1-20  Are  you  currently  in  an  establishment  position? 


1 


Yes 


2 


No 


> 
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1-21 

Do 

you  expect  your  job  to  be  filled  when  you  are  posted? 

1  . 

Yes 

2.  No 

1-22 

On  your  current 
(more  than  25%) 

Job  do  you  spend  a  significant  amount  of  time 
involved  in  long  term  planning? 

1 . 

Yes 

2.  No 

GO  ON  TO  THE  NEXT  SECTION 


I 


C 
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SECnOR  2 


JOB  IHVERTORY 


Instructions 


1 .  In  this  section  you  are  presented  with  a  number  of  statements 

which  refer  to  your  Job.  Read  each  statement  carefully  and  then  decided  to 
what  extent  the  statement  is  true  of  your  job.  Indicate  the  extent  that  the 
statement  is  true  for  your  job  by  choosing  the  scale  item  that  best 
represents  your  job. 


1  =  Not  at  all 

2  =  To  a  very  little  extent 

3  =  To  a  little  extent 

A  =  To  a  moderate  extent 

Not  at  all  1  2  3  A  5  6  7 


5  =  To  a  fairly  large  extent 

6  =  To  a  great  extent 

7  =  To  a  very  great  extent 


To  a  very  great  extent 


2.  Select  the  corresponding  number  for  each  question  and  enter  it  on 

the  separate  answer  sheet. 

2-1  To  what  extent  does  your  job  provide  a  challenge,  in  requiring  you 

to  use  -the  entire  range  of  your  training  and  experience? 

2-2  To  what  extent  is  your  job  significant,  in  that  it  affects  others 

in  some  important  way? 

2-3  To  what  extent  does  your  job  provide  a  great  deal  of  freedom  and 

Independence  in  scheduling  your  work  and  selecting  your  own  procedures  to 
accomplish  it? 

2-A  To  what  extent  does  juat  doing  your  job  provide  you  with  chances 

to  find  out  how  well  you  are  doing? 

I 

2-5  To  what  extent  do  "additional  duties"  interfere  with  the 

performance  of  your  primary  job? 

2-6  To  what  extent  do  you  have  adequate  personnel  resources  to 

accomplish  your  job? 

t 

2-7  To  what  extent  do  you  have  adequate  financial  resources  to 

accomplish  your  job? 

2-8  To  what  extent  is  the  amount  of  work  space  provided  adequate  for 

the  work  being  performed? 

2-9  To  what  extent  does  your  job  provide  the  chance  to  be  responsible 

for  your  own  work? 

2-10  To  what  extent  does  doing  your  job  well  affect  many  people? 

2-11  To  what  extent  does  your  job  require  you  to  be  a  "generalist"  as  > 

opposed  to  being  a  "specialist"? 
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1  =  Not  at  all  5  =  To  a  fairly  large  extent 

2  =  To  a  very  little  extent  6  =  To  a  great  extent 

3  =  To  a  little  extent  7  =  To  a  very  great  extent 

4  =  To  a  moderate  extent 


2-12  To  what  extent  does  your  job  give  you  freedom  to  do  your  work  as 
you  see  fit? 

2-13  To  what  extent  are  you  allowed  to  make  the  major  decisions 
required  to  perform  your  job  well? 

2-1 A  To  what  extent  are  you  proud  of  your  job? 

2-15  To  what  extent  do  you  know  exactly  what  is  expected  of  you  in 

performing  your  job? 

2-16  To  what  extent  are  your  job  performance  goals  (as  specified  by  the 
organisation)  difficult  to  accomplish? 

2-17  To  what  extent  are  your  job  performance  goals  clear  and  specific? 

2-18  To  what  extent  are  your  job  performance  goals  realistic? 

2-19  To  what  extent  does  your  job  keep  you  busy? 

2-20  To  what  extent  do  you  know  wh^t  the  objectives  of  the  Army  are? 

2-21  To  what  extent  are  you  being  prepared  to  accept  increased 

responsibility? 

2-22  To  what  extent  do  people  who  perform  well  receive  recognition? 

2-23  To  what  extent  do  you  feel  adequately  trained  to  perform  your  job? 

2-24  To  what  extent  does  your  work  give  you  pride  and  a  feeling  of 

self-worth? 


GO  ON  TO  THE  NEXT  SECTION 
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.SEcnoii  3 


JOB  SATISFACnOW  QOESTIOHllAIHE 


Instructions 

1 .  The  items  below  relate  to  your  current  Job  and  the  Army  as  a 
profession.  Indicate  your  satisfaction  or  dissatisfaction  with  each  item  on 
a  seven  point  scale. 

2.  For  items  not  applicable  to  you,  write  "0"  as  your  emswer. 
Extremely  dissatisfied  1234567  Extremely  satisfied 


3-1  Information  on  policies  and  procedures. 

The  adequacy  and  availability  of  information  on  policies. 

3-2  Feeling  of  helpfulness 

The  chance  to  help  people  and  improve  their  welfare  through 
the  performance  of  your  job. 

3-3  Characteristics  of  the  local  area 

The  geographical  area  in  which  you  work. 

3-4  Social  contact 

Opportunity  to  meet  new  people  and  the  meaningfulness  of 
social  contacts  required  by  the  Job. 

3-5  Family  attitude  towards  job 

The  recognition  and  the  pride  your  family  has  in  the  work 
you  do. 

3-6  Self-improvement  opportunities 

The  educational  and  recreational  opportunities  provided. 

3-7  Verbal  and  written  communication 

The  amount  of  required  telephone  communication  and  required 
paperwork  in  your  job. 

3-8  Work  Itself 

The  challenge,  interest,  importance,  variety  and  feelings 
of  accomplishment  you  receive  from  your  work. 

3-9  Acquired  valuable  skills 

The  chance  to  acquire  valuable  skills  in  your  job  which 
prepare  you  for  future  opportunities. 

3-10  Support  services 

Medical,  dental  and  legal  services  provided. 

3-11  Your  job  as  a  whole. 

3-12  Community  attitudes 

Attitudes  in  the  general  community  about  the  profession 
of  arms. 


GO  ON  TO  THE  NEXT  SECTION 
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SECnOH  k 
SOPERVISIOH 

Instructions 

1.  The  statements  below  describe  characteristics  of  managers. 
Indicate  your  agreement  with  statements  by  choosing  the  point  on  the  seven 
point  scale  which  best  represents  your  attitude  concerning  your  immediate 
superior.  You  are  reminded  that  your  answers  will  remain  anonymous. 

2.  For  items  not  applicable  to  you,  write  "0"  as  your  answer. 

Strongly  disagree  1  234567  Strongly  agree 

4-1  My  immediate  superior  (IS)  tells  me  exactly  what  he  expects 

me  to  do. 

4-2  My  IS  is  not  a  good  planner. 

4-3  My  IS  does  not  set  high  performance  standards. 

4-4  My  IS  informs  me  of  changes  in  advance. 

4-5  My  IS  is  not  consistent  in  predicting  events  in  our 

organisation. 

4-6  My  IS  does  not  perform  well  under  pressure. 

4-7  My  IS  encourages  me  toward  greater  accomplishment. 

4-8  My  IS  over  controls  ray  work. 

4-9  My  IS  is  approachable. 

4-10  My  IS  takes  time  to  help  me  when  needed. 

4-11  My  IS  respects  my  opinions  in  his  decision  making. 

4-12  My  IS  is  not  very  interested  in  helping  resolve  my  problems. 

4-13  My  IS  helps  to  stimulate  enthusiasm  for  the  job. 

4-14  My  IS  helps  me  set  specific  goals. 

4-15  My  IS  is  not  consistent  in  his  managerial  behaviour. 

4-16  My  IS  does  not  let  me  know  when  I  am  doing  a  good  job. 

4-17  My  IS  lets  me  know  when  I  am  doing  a  poor  job. 

4-18  My  IS  always  helps  me  Improve  ray  performance. 

4-1 9  Feedback  from  my  IS  has  contributed  significantly  to 
Improvement  in  my  job  performance. 

4-20  My  IS  encourages  ideas  for  improving  procedures. 

4-21  My  IS  is  not  an  effective  manager. 
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strongly  disagree  1  234567  Strongly  agree 

4-22  My  IS  keeps  me  informed  of  changes  that  affect  my  job. 

4-23  My  IS  rarely  gives  me  feedback  on  how  well  I  am  doing  my 
job. 

4-24  My  IS  usually  supports  my  decisions. 

GO  OB  TO  THE  NEXT  SECTION 
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SECTIOH  5 

ORGAHISATIOH  CLIMATE  mVEMTOBY 


Instructions 

1 .  Below  are  Items  which  describe  characteristics  of  your 

organisation.  Indicate  your  agreement  by  choosing  a  point  on  the  seven 

point  scale  which  best  represents  your  opinion  concerning  your  organisation 

{in  this  case,  the  Army  as  a  whole,  not  unit  or  formation). 

Strongly  disagree  1  234567  Strongly  agree 

5-1  Your  organisation  provides  all  the  necessary  information 

for  you  to  do  your  job  effectively. 

5-2  Your  organisation  does  not  always  provide  adequate  and 

accurate  information  to  you. 

5-3  You  are  usually  aware  of  important  events  and  situations. 

5-4  Your  complaints  are  aired  satisfactorily. 

5-5  Your  organisation  is  not  very  effective  when  it  comes  to 

planning. 

5-6  Your  organisation  is  better  run  now  than  in  the  past. 

5-7  Your  organisation  is  very  interested  in  the  attitudes  of 

members  toward  their  jobs. 

5-8  You  are  very  proud  to  work  for  this  organisation. 

5-9  The  people  affected  by  decisions  are  not  asked  for  their 

ideas  before  the  decisions  are  made. 

5-10  Personnel  are  not  recognized  for  outstanding  performance. 

5-11  This  organisation  does  not  have  clear-cut  reasonable  goals. 

5-12  You  feel  motivated  to  contribute  your  best  efforts  to  this 
organisation. 

5-13  This  organisation  does  not  reward  individuals  based  on 

performance. 

5-14  This  organisation  insures  that  you  have  the  necessary  resources 

to  accomplish  the  Job. 

5-15  In  accomplishing  a  particular  task,  you  tend  to  rely  more  on 
personal  contact,  rather  than  on  formal  channels. 


C»  ON  TO  THE  NEXT  SECTION 
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SECnOH  6 

MAHAGB>!EHT  mTERVEtlTIOHS 


Instructions 

1.  Below  are  listed  11  commonly  used  management  'interventions'  or 
areas  where  changes  can  be  introduced  in  an  attempt  to  increase 
effectiveness . 

2.  Indicate  your  familiarity  in  using  each  of  the  interventions  by 
selecting  the  appropriate  point  on  the  seven  point  scale  and  recording  the 
answer  on  the  separate  answer  sheet. 

No  familiarity  1  234567  Great  deal  of  familiarity 

6-1  Recruitment  and  Selection 

6-2  Training  and  Instruction 

6-3  Appraisal  and  Feedback 

6-4  Goal  Setting 

6-5  Financial  Compensation 

6-6  Work  Redesign  (Changes  to  job  variety,  scope  of 

responsibilities,  amount  of  supervision,  etc) 

6-7  Supervisory  Methods 

6-8  Organisational  Structure/Design 

6-9  Decision  making  methods 

6-10  Work  schedules 

6-11  Sociotechnical  Interventions  (Focus  is  on  getting  the  best 

match  of  people  and  the 
equipment  and  methods  in  the 
organisation) . 

For  the  following  questions  record  a  number  on  the  answer  sheet  between  1 
and  11  corresponding  to  one  of  the  interventions  listed  above. 

6-12  In  efforts  to  maximize  effectiveness  which  of  the  'interventions' 

listed  above  do  you  think  the  organisation  makes  the  best  use  of? 

6-13  Which  single  intervention  is  not  well  used? 

6-14  In  your  own  Job,  which  single  intervention  receives  the  most 

attention? 

6-15  With  which  single  intervention  do  you  have  the  most  experence  in 
using? 


3 


» 
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I 

The  list  below  consists  of  positive  reportable  items  under  the  POR/AMAN 


system. 

] 

6-16 

If  you  were  required  to  assess  general  unit  performance  and  had 
no  other  Information  available,  which  single  item  would  be 
given  the  most  weight? 

1 .  Long  service  awards 

2.  Course  passes 

3.  fle-enllstments 

4.  Re-engagements  in  advance  of  due  date. 

6-17 

Which  item  immediately  above  would  be  given  the  least  weight? 

The  list 
system. 

below  consists  of  negative  reportable  items  under  the  POR/AMAN 

6-18 

If  you  were  required  to  assess  general  unit  performance  and 
had  no  other  information  available,  which  single  item  would 
be  given  the  most  weight? 

6-19 

Which  item  would  be  given  the  least  weight? 

4 

1 . 

AWOL's 

2, 

Military  and  civil  offenses 

3. 

Reductions  in  rank 

4. 

Warnings  for  discharge. 

4 


GO  ON  TO  THE  NEXT  SECTION 
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SECnOH  7 

MAHAGHgarr  techmiqoes  and  approaches  j 


The  following  definitions  should  be  referred  to  when  answering  questions  in 
this  section. 

1 .  Network  Analysis  ( PERT  -  Performance  Evaluation  and  Review 
Techniques  and  CPM  -  Critical  Path  Method).  In  complicated  projects  it  is 
beyond  the  power  of  any  individual  to  keep  all  tasks  and  their 
inter-relationships  in  mind  and  figure  out  the  effect  of  speeding  up  one 
step  on  total  project  time.  PERT  is  used  to  get  around  these  difficulties 
by  the  use  of  a  network  to  depict  graphically  a  project  plan.  CPM 
identifies  activities  which  are  'critical*  based  on  the  scheduled  duration 
of  the  project. 

2.  Management  by  Objectives  emphasizes  the  specification  of  work 
objectives,  monitoring  of  accomplishments,  reward  attainment  when  objectives 
are  met,  and  participation  in  the  setting  and  review  of  work  objectives. 

3.  Value  Analysis  (Value  Engineering)  is  a  set  of  evaluation 
techniques  used  to  relate  cost  to  worth,  taking  into  account  function, 
timeliness,  and  alternatives.  Value  Analysis  techniques  emphasize  problem 
solving  through  the  definition  of  critical  factors. 

A.  Quality  Circles  (QCs)  are  small  groups  of  employees  who  meet  on  a 

regular  basis  to  identify,  analyze,  and  solve  problems  they  experience  on 
their  jobs.  Through  QCs,  employees  serve  as  "in-house"  consultants  on  how 
to  improve  conditions  and  results.  Participation  is  voluntary.  Each  member 
of  a  circle  has  the  opportunity  to  make  suggestions  or  contribute  in  an 
effort  to  enhance  the  quality  of  services  provided;  solve  work  place 
problems;  develop  a  closer  identification  with  the  goals  of  the 
organisation,  and  improve  communication  between  supervisors  and  workers. 

5.  Electronic  Spreadsheets  are  self  contained  computer  software 
programmes  that  greatly  simplify  planning,  budgeting  and  forecasting.  These 
programmes  allow  the  re-calculation  of  an  entire  page  of  figures  every  time 
a  single  basic  element  is  changed.  This  is  particularly  useful  in  testing 
questions  that  begin  "what  if".  In  the  military  organisation  these 
programmes  are  particularly  well  suited  to  such  functions  as  strenght 
management  and  allocation  of  soldiers  to  Corps. 

i 

6.  Organisation  Development  (OD)  is  a  planned  model  of  long  range 
change  in  organisations  based  '■n  analysis  of  systems.  CD  emphasizes  such 
techniques  as  team  building,  conflict  resolution  and  Intergroup 
laboratories . 

7 .  Divergent  Problem  Solving  is  a  wide  group  of  concepts  and  ) 

techniques  used  where  many  original  solutions  to  a  problem  may  be  required 
Instead  of  one  "correct"  solution  or  where  a  problem  is  not  well  defined  and 

may  require  the  solving  of  multiple  sub-problems.  Concepts  employed  include 
the  questioning  of  basic  assumptions,  attribute  listing,  cause  and  effect 
reversals  and  structured  mathematical  approaches. 

» 
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Instructions 


1 .  The  list  below  consists  of  a  range  of  managerial  techniques  and 
approaches.  Answer  the  questions  by  indicating  your  familiarity  with  the 
listed  techniques  and  recording  the  answer  on  the  separate  answer  sheet. 

2.  Some  of  the  questions  also  require  that  you  list  individual 
numbers  on  this  questionnaire. 

1.  Network  Analysis  (PERT,  CPM) 

2.  M2inagement  by  Objectives 

3.  Value  Analysis 
A.  Quality  Circles 

5.  Electronic  Spreadsheets 

6.  Organization  Development 

7.  Divergent  Problem  Solving 

7-1  How  many  of  the  methods  in  the  list  have  you  heard  of  before? 

(Record  total  number  on  the  answer  sheet  and  list  individual 
numbers  here)  _ 


7-2  How  many  of  the  methods  in  the  list  have  you  observed  being 

used?  (Record  total  number  on  the  answer  sheet  and  list 
individual  numbers  here)  _ . 

7-3  For  how  many  methods  in  the  list  have  you  received  Army 

sponsored  training?  (Record  total  number  on  the  answer  sheet 
and  list  individual  numbers  here)  _ . 

7-A  For  how  many  methods  in  the  list  have  you  received  training 

outside  the  Array?  (Record  total  number  on  the  answer  sheet 
and  list  individual  numbers  here) _ . 

7-5  How  many  of  the  methods  in  the  list  have  you  made  some  use  of? 

(Record  total  number  on  the  answer  sheet  and  list  individual 
numbers  here)  _ _ . 

7-6  How  many  of  the  methods  in  the  list  have  you  made  extensive 

use  of?  (Record  total  number  on  the  answer  sheet  and  list 
individual  numbers  here)  _ . 

7-7  How  many  of  the  methods  in  the  list  do  you  make  daily  use  of? 

(Record  total  number  on  the  answer  sheet  and  list  individual 
numbers  here)  _ . 

7-8  What  other  structured  management  techniques  have  you  made  use 

of?  (List) 


7-9  In  your  current  appointment  how  often  do  you  make  use  of  Army 

computer  (EDP)  facilities)?  (record  on  answer  sheet). 


1 .  Never 

2.  Rarely 

3.  Occassionally 


A.  Daily 
5.  Constantly 


[ 

[ 
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Answer  the  following  questions  by  choosing  the  appropriate  point  on  the 

seven  point  scale  and  recording  the  answer  on  the  separate  answer  sheet. 

No  relevance  1  234567  Very  relevant 

7-10  In  general  terms,  to  what  extent  do  management  experience  and 

management  techniques  In  the  general  community  have  relevance 
for  Army  managers? 

7-1 1  To  what  extent  have  management  experience  and  management 

techniques  from  the  general  community  been  relevant  in  your 
previous  job  appointments? 

7-1 2  To  what  extent  do  management  and  management  techniques  from 

the  general  community  have  relevance  in  your  current  appointment? 

7-13  In  what  areas  are  there  significant  differences  between  the 

tasks  of  civilian  managers  and  Army  managers? 

(detail  your  answer  below). 
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GO  ON  TO  THE  NEXT  SECTION 
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SECnOH  8 

PERCEIVED  EFFECnVEHESS 


InatructloM 

1.  The  statements  below  deal  with  work  performance.  Indicate  your 
agreement  with  each  statement  by  selecting  the  point  on  the  seven  point 
scale  that  best  represents  your  attitude  concerning  work  performance. 

2.  For  some  jobs  certain  statement  may  not  be  applicable.  Should 
this  be  the  case  record  an  ”0"  for  the  statement  on  the  answer  sheet. 

Strongly  disagree  1  2  3  A  5  6  7  Strongly  agree 

8-1  The  QUANTITY  of  output  of  your  section  or  unit  is  very  high. 

8-2  The  QUANTITY  of  output  of  your  section  or  unit  has  improved 

significantly  since  your  arrival. 

8-3  The  QUALITY  of  work  of  your  section  or  unit  is  very  high. 

8-A  The  QUALITY  of  work  of  your  section  or  unit  has  not  improved 

significantly  since  your  arrival. 

8-5  Your  section  or  unit  always  get  maximum  output  from  available 

resources  (e.g.  personnel  and  material). 

8-6  Your  section  or  unit's  performance  in  comparison  to  similar 

units  is  very  high. 

8-7  Your  section  or  unit  does  not  perform  very  effectively  under 

pressure. 

8-8  Your  co-workers  maintain  very  high  standards  of  performance. 

8-9  The  members  of  your  section  or  unit  do  not  perform  very  well 

when  involved  in  unexpected  deadlines. 

8-10  You  get  the  very  best  out  of  sub-ordinates  under  all  conditions. 

8-1 1  You  consider  yourself  to  be  a  very  good  "man  manager" . 

8-12  You  are  better  at  mainaging  "things"  rather  than  dealing  with 

people. 

8-13  Your  section  or  unit  generally  gets  work  out  on  a  timely  basis 

meeting  most  time  constraints  or  deadlines. 

8-14  In  some  respects  your  section  or  unit  is  better  than  others 

because  _ 

8-1 5  In  some  respects  your  section  or  unit  Is  not  as  good  as  others 

because 
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8-17  Your  section  or  unit  is  better  than  others  because  of  the 
emphasis  on  teamwork. 

8-18  Your  section  or  unit  is  better  than  others  because  of  an  emphasis 
on  time  constraints. 

8-19  Your  section  or  unit  is  worse  than  others  because  of  manning 
shortfalls. 

8-20  Your  section  or  unit  is  worse  than  others  because  of  a  lack  of 
diversity  or  depth  of  training  and  experience. 

8-21  Your  section  or  unit  is  worse  than  others  because  of  a  lack 

of  equipment. 

8-22  Your  section  or  unit  is  better  than  others  because  of  the 
mateship  and  mutual  support  that  exists. 
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District  Support  Unit  (Melbourne) 
Victoria  Barracks 
St  Kilda  Road 
MELBOURNE  VIC  3004 


Z'?  June  1936 


District  Psychology  Officer 
3rd  Military  District 
Victoria  Barracks 
St  Kilda  Road 
MELBOURNE  VIC  3004 

Deputy  Chief  of  Personnel 
Department  of  Defence  (Army  Office) 
CANBERRA  ACT  2600 

For  Information: 

Directorate  of  Psychology  -  Army 
(CP4-6-02) 

Department  of  Defence  (Army  Office) 
CANBERRA  ACT  2600 


PROPOSED  STUDY  OF  ORGANISATIONAL  EFFECTIVENESS 


1.  Currently  I  am  engaged  in  two  years  long  term  schooling 
doing  a  Master  of  Arts  degree  in  Applied  Psychology  at  the 
University  of  Melbourne.  Partial  requirement  for  the  degree 

is  completion  of  a  'minor'  thesis.  While  there  is  no  requirement 
that  the  thesis  topic  involve  the  Army,  it  is  logical  that  the 
area  of  study  should  be  one  that  would  benefit  the  Army. 

2.  The  topic  I  have  chosen  for  a  thesis  is  Organisational 
Effectiveness  in  Military  Organisations.  This  topic  was  chosen 
after  reviewing  the  available  literature. 

3.  In  a  climate  of  increased  scrutiny  of  public  sector 
spending,  the  Australian  Department  of  Defence  has  been 
criticised  frequently  for  project  management  shortcomings. 
Overseas  a  similar  climate  prevails  and,  together  with 
unfavourable  productivity  comparisons  for  the  US  against  such 
countries  as  Japan,  this  has  led  to  increased  organisational 
research  efforts.  These  efforts  have  led  among  other  things 
to  the  development  of  methodologies  for  the  evaluation  of 
organisational  performance.  There  have  also  been  studies  to 
evaluate  the  effects  of  traditional  management  techniques, 
organisational  effectiveness  programmes,  organisational 
assessment  procedures  and  management  interventions. 
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4.  These  various  research  efforts  have  not  been  co-ordinated 
or  comprehensive,  even  within  the  US  Defence  Department.  For 
example,  the  US  Army  has  for  10  years  been  implementing  an 
Organisational  Effectiveness  Programme,  while  the  US  Air  Force 
has  developed  and  implemented  an  Organisational  Assessment 
Procedure . 

5.  To  date,  there  has  not  been  any  concerted  effort  to 
study  the  effect  of  a  range  of  specific  management  techniques 
on  productivity  and  effectiveness.  The  proposed  study  (Annex 
A)  would  survey  the  attitudes  of  a  sample  of  Army  Officers  in 
the  ranks  of  Major  and  Lieutenant  Colonel  regarding: 

a.  their  familiarity  with,  training  in,  and  experience 
in  using  a  range  of  management  techniques; 

b.  the  effectiveness  of  their  own  efforts  and  those  of 
the  members  with  whom  they  work; 

c.  the  work  climate  in  the  Army;  and 

d.  management-  styles . 

6.  Possible  benefits  to  the  Army  from  the  proposed  study 
include : 


a.  An  estimate  of  the  management  skills  available  in  the 
Army. 

b.  The  development  of  a  framework  that  would  allow  the 
identification  of  those  management  interventions  that 
are  most  relevant  and  most  useful  to  the  Army  in  specific 
areas.  (Keeping  in  mind  that  there  may  be  a  culture 
specific  element  in  the  use  of  some  interventions). 

c.  A  proposal  for  the  development  of  useful  measurement 
indicators  of  effectiveness  on  a  component  and  global 
level  incorporating  data  from  the  POR/AMAN  system. 

d.  The  collection  of  data  on  the  use  of  management 
techniques  and  management  interventions  that  could  be 
taken  into  account  when  making  specific  decisions 
concerning  management  training  in  the  Array. 

7.  Approval  is  sought  to  carry  out  a  study  into 

organisational  effectiveness  that  would  require  the  followino- 
resources  from  the  Army:  ° 

a.  Names  and  appointments  of  30  Army  Officers  in  the  worn 

rank  of  Major  and  10  Officers  in  the  worn  rank  of 
Lieutenant  Colonel  in  Che  Melbourne  area  and 
authorisation  to  interview  those  Officers  for  the  pilot 
study  commencing  September  1986. 
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b.  Printing  of  380  questionnaires  for  the  final  study  and 

the  mailing  of  those  questionnaires  with  cover  letters 
endorsing  the  study  to  280  Officers  in  the  rank  of  Major 
and  100  Officers  in  the  rank  of  Lieutenant  Colonel. 

All  Officers  randomly  selected  using  a  list  of  random 
numbers,  without  regard  for  Corps,  posted  area,  etc. 


R.C.  FURRY 


Major 

Long  Term  Schooling 


I 
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Annex  A 


PROPOSAL  FOR  A  THESIS  ON  ORGANISATIONAL  EFFECTIVENESS 
IN  MILITARY  ORGANISATIONS 


Background 


1.  While  there  has  always  been  an  interest  in  increasing 
effectiveness  in  organisations,  widespread  concerted  efforts 
were  first  seen  in  the  mid  1970' s.  These  efforts  came  about 
because  of  an  increasing  awareness  in  the  United  States  that 
productivity  on  a  national  level  was  steadily  decreasing.  The 
response  was  legislation  in  the  form  of  public  law  94-136  of 
1975  to  stimulate  efforts  to  accurately  measure  productivity 
efforts  and  to  encourage  those  efforts.  The  public  law  was 
followed  by  a  defence  instruction  which  was  followed  by 
individual  instructions  for  the  military  services. 

2.  Katzell  and  others  (1),  and  Guzzo  and  Bondy  (2) 
summarised  207  productivity  experiments  (including  military) 

for  the  period  1971-81.  877.  of  these  experiments  found  evidence 

of  improvement  in  at  least  one  aspect  of  productivity.  The 
interventions  looked  at  in  these  studies  included: 

a.  Recruitment  and  selection; 

b.  Training  and  Instruction; 

c.  Appraisal  and  feedback; 

d.  Goal  setting; 

e.  Compensation; 

f.  Wc.rk  redesign; 

g.  Supervisory  methods; 

h.  Organisational  structure/design; 

i.  Decision  making; 

j.  Changes  in  work  schedules;  and 

k.  Sociotechnical  interventions. 


(1)  Katzell,  R.A. ,  Bienitock,  P.,  Faerstein,  P.F.  A  Guide  to 

Worker  Productivity  Experiments  in  the  United  States  1971- 
76.  New  York,  New  York  University  Press.  1977. 

(2)  Guzzo,  R.A.  &  Bondy,  J.  A  Guide  to  Worker  Productivity 

Experiments  in  the  United  States  1976-1981.  New  York, 
Pergamon.  1983. 
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3.  Guzzo  and  oChers  (3)  applied  meCa-analysis  to  98  of 

the  original  207  experiments  (that  did  not  omit  needed  data) 
and  found: 

a.  As  a  whole  the  93  experiments  significantly  improved 
some  concrete  aspect  of  productivity  by  one-half  a 
standard  deviation. 

b.  Programmes  with  the  most  powerful  effects  on  productivity 
were  those  involving  training  and  goal  setting.  Large 
scale  sociotechnical  interventions  also  showed  greater 
than  average  impact.  Programmes  of  work  design  and 

of  appraisal  and  feedback  had  Che  next  most  powerful 
effects,  followed  by  interventions  involving  schedules 
of  work,  supervisory  methods  and  management  by 
objectives.  Even  those  weakest  treatments  had  effects 
Chat  were  appreciable  and  statistically  significant. 

c.  The  impact  of  interventions  in  government  was 
substantially  greater  than  that  in  other  types  of 
organisations . 

d.  The  productivity  effects  were  markedly  greater  for 
managerial/professional  workers. 

A.  Within  military  organisations  in  recent  years  there 

have  been  concerted  efforts  to  develop  methods  Co  measure  more 
precisely  the  impact  of  organisational  interventions.  These 
include ; 


a.  The  development  in  a  military  environment  (4)  of  a  method 
using  meta-analysis  to  translate  findings  into 
economically  meaningful  terms  (rather  Chan  on 
psychological  scales)  in  Che  form  of  Che  standard 
deviation  of  job  perfonr.nce  in  dollar  terms. 

b.  The  development  by  T.C.  Tuttle  (5)  of  a  methodology 
for  generating  productivity  indicators. 


(3)  Guzzo,  R.A.,  Jette,  R.L.  &  KaCzell,  R.A.  'The  Effects  of 

Psychologically  Based  Intervention  Programs  on  Worker 
Productivity;  A  Meta-Analysis’.  Personnel  Psychology 
38.  1985.  275-291. 

(4)  Hunter,  J.E.  &  Schmidt,  F.L.  'Quantifying  the  Effects  of 

Psychological  Interventions  on  Employee  Job  Performance 
and  Work-force  Productivity'.  American  Psychologist  33, 
1983.  473-78. 

Tuttle,  T.C.  Productivity  Measurement  Methods: 

Classification,  Critique,  and  Implications  for  the  Air 
Force.  Air  Force  Human  Resources  Laboratory,  Brooks  Air 
Force  Base,  Texas.  1981. 


(5) 


c.  The  developmenc  within  the  US  Air  Force  (6)  of  an 

Organisational  Assessment  package  used  to  gather  research 
to  strengthen  the  Air  Force  organisational  effectiveness 
programme.  The  package  looks  at  a  variety  of  criteria 
including  job  satisfaction,  organisational  climate  and 
perceived  productivity.  By  19S4  the  survey  had  been 
administered  to  4,786  military  and  civilian  personnel. 

5.  The  'wild  card'  among  productivity  enhancement  methods 
has  been  the  reported  dramatic  effects  of  using  Quality  Circles 
(group  suggestion  methods)  in  the  US  Army  (7)  and  US  Navy  (8). 

In  the  case  of  the  Army  a  return  on  investment  in  productivity 
of  about  2  to  1  is  reported. 

6.  The  US  Army  developed  an  Organisational  Effectiveness 
programme  that  trained  more  than  1,700  Organisational 
Effectiveness  Staff  Officers  (OESO)  to  act  as  consultants  and 
"...  apply  an  Integrated  blend  of  knowledge  and  skills  drawn 
from  behavioural,  management,  systems  sciences  specifically 
tailored  to  meet  the  changing  needs  of  the  Army."  (9) 

7.  Work  by  Broedling  and  others  (10)  has  assessed  manager's 
knowledge  and  perceptions  of  various  management  practices  and 
leadership  techniques  by  the  use  of  a  Management  Techniques 
Inventory. 

8.  It  is  not  intended  to  suggest  that  previous  studies 
generalise  across  cultural  backgrounds  or  even  between 
organisations.  What  is  suggested  is  that  the  studies  provide 
clues  to  what  areas  are  deserving  of  attention  when  considering 
the  question  of  effectiveness  and  the  range  of  methods  used  in 
an  effort  to  enhance  that  effectiveness  in  the  organisation. 

It  also  has  to  be  remembered  that  techniques  and  interventions 
follow  problems,  not  the  other  way  around. 


(6)  Hendrix,  W.H.  &  Halverson,  V.B.  Organisationa.l  Survey 

Assessment  Package  for  Air  Force  Organisations.  Air 
Force  Human  Resources  Laboratory,  Brooks  Air  Force  Base, 
Texas.  1979. 

(7)  Schneider,  'Organisational  Behaviour'  Annual  Review  of 

Psychology,  1985.  p  600. 

(8)  Atwater,  L.  &  Sander,  S.  Quality  Circles  (QCs)  in  Navy 

Organisations:  An  Evaluation.  Naval  Personnel  Research 
and  Developmenc  Center  report  TR  84-53,  San  Diego,  1984. 

(9)  Hayden,  D.C.  'Training  OESOs ;  A  View  of  the  Curriculum'. 

Army  Organisational  Effectiveness  Journal,  No.  1,  1985, 

86-88. 

(10)  Broedling,  L.A. ,  Githens,  W.H.  &  Reidel,  J.A.  Developmenc 

of  a  Management  Techniques  Inventory.  Navy  Personnel 
Research  and  Development  Center  technical  note  1977  (Apr) 
No.  77-12,  San  Diego,  California. 
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Aim 

9.  The  proposed  sCudy  will  look  at  Che  effect  of  Che  use 

of  management  techniques  on  management  Interventions  and 
perceived  effectiveness.  The  more  generally  used  criteria  of 
job  satisfaction,  management  style  and  organisational  climate 
will  also  be  studied  in  terms  of  their  effect  on  perceived 
effectiveness.  Assumptions  being  made  are: 

a.  Military  organisations  are  in  the  forefront  of  using 
manageriril  interventions  Co  increase  effectiveness, 
but  there  is  not  always  a  concerted  effort  Co  measure 
programme  impact. 

b.  There  is  a  tendency  by  military  managers  to  resist  the 
use  of  certain  management  techniques  and  civilian 
management  experience  as  being  inapplicable  Co  the  goals 
of  military  organisations. 

Figure  1  depicts  Che  relationships  to  be  investigated  in  Che 
s  tudy . 


Fig.  1 


Management  Training 


Management  Techniques 


i 

Management  Interventions 

I 


Perceived  Effectiveness 


t  t 

Job  Satisfaction 


Management  Style 


Organisational  Climate 


Mote : 

Management  Techniques  used  in  the  Model  include: 

Value  analysis 

Network  analysis  (Performance  Evaluati*"  and  Review 
Techniques,  Critical  Path  Method) 
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Management  by  objectives 
Organisational  Development 
Divergent  problem  solving 
Electronic  spreadsheets 
Quality  circles 
Others 

Management  Interventions  referred  to  in  the  Model  Include: 
Recruitment  and  selection 
Training  and  instruction 
Appraisal  and  feedback 
Goal  setting 
Financial  compensation 
Work  redesign 
Supervisory  methods 
Organisational  structure /design 
Decision  making 
Work  schedules 

Sociotechnical  interventions 

Method 

10.  The  proposed  study  will  make  use  of  attitudinal  and 
perceptual  measures  in  the  form  of  a  survey  instrument  consisting 
of  scales  and  inventories.  The  survey  instrument  will  be  used 

to  look  at  job  characteristics;  job  satisfaction;  supervision 
and  management  style;  organisational  climate;  and  the  use  of 
management  interventions  and  management  techniques.  The  effect 
of  each  of  these  will  be  measured  against  perceived 
effectiveness.  Quantitative  measures  of  job  behaviour  and  system 
performance  have  not  been  used  because  measurement  Indicators 
have  not  yet  been  developed.  The  development  of  measurement 
indicators  will  be  discussed  in  the  thesis  and  a  proposal  made 
for  the  use  of  data  from  the  POR/AMAN  system  to  be  used  in 
constructing  measurement  indicators. 

11.  The  survey  questionnaire  will  be-  mailed  to  280  Officers 
in  the  worn  rank  of  Major  and  100  Officers  in  the  worn  rank  of 
Lieutenant  Colonel .  Survey  questions  will  be  pretested  in  a 
pilot  study  consisting  of  interviews  with  30  Officers  in  the 
rank  of  Major  and  10  Officers  in  the  rank  of  Lieutenant  Colonel 
in  the  Melbourne  area.  Officers  for  the  main  study  will  be 
selected  at  random  (except  for  rank)  using  a  list  of  random 
numbers.  The  ranks  chosen  for  the  study  represent  middle 
management  in  the  Army. 
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AN^EX  C 


DEPARTMENT  DF 


RUSSELL  OFFICSS 
CANBERRA.  A.C.T.  2600 


DCPEBS  221/86  •“  “"o’*- 

July  1986 
HQ  3  MD 

request  for  assistance  -  LONG  TERM  STUDENT 
63114  MAJOR  R.C.  FURRY 


Reference: 

A.  HQ  3  MD  101/1/1  of  17  Jun  86 


1.  Approval  is  given  for  Major  Furry  to  conduct  a 

pilot  study  and  further  survey  on  organisational  effectiveness 

as  outlined  in  his  letter  of  17  Jun  86. 

2.  This  approval  is  given  on  the  basis  that: 

a.  costs  will  be  limited  to  the  printing  and 
distribution  of  questionnaires  (using  Departmental 
resources ) ; 

b.  the  project  will  be  supervised  by  the  District 
Psychology  Officer,  HQ  3  MD; 

c.  mailing  lists  will  be  provided  by  the  Military 
Secretary's  staff  (Captain  Judy  Avexy,  Tel  653655) 
through  the  MS  staff  at  HQ  3  MD. 

3.  Supervision  of  this  project  sh'ould  give  close 

attention  to: 

a.  the  measure  of  effectiveness.  This  must  be  primarily 

concerned  with  operational  or  war-fighting  efficiency; 

i>.  principle  vs  technique.  Management  training  in  the 

Army  should,  a.nd  does  to  a  large  degree,  emphasise 
the  application  of  principles  rather  than  'fashionable 
techniques ; 


c. 


management  vs  leadership.  Army  officers  are 
e:q3ected  to  be  leaders.  Management  and  'management 
style*  must  be  seen  as  a  component  of  the  officer's 
skill  as  a  leader. 

4.  A  further  suggested  reference  is  attached. 


P.R.  PHILLIPS 
Brigadier 

Deputy  Chief  of  Personnel  -  Array 


Attachment : 


1.  Eaton  N.K.  et  ad  'Alternative  Methods  of  Estimating 

the  Dollar  Value  of  Performance',  Personnel  Psvcholo<r>/ . 
1985,  38 


Ane  D 
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DEPARTMENT  DF  DEFENCE 


RUMEU.  OFFICES 
CANSERRA.  A.C.T.  2000 


IN  REPLY  OUOTKi 


DCPERS  /an 

Jc,  March  1987 


ORGAVIZATIOyAL  EFFECTIVENESS  STUDY 


1.  Major  R.  Furry,  aa  Psych,  is  currently  completing  a 
Masters  Degree  in  Applied  Psychology  at  the  Melbourne  University 
A  principal  reguirement  for  Che  degree  is  the  submission  of  a 
thesis  titled,  "Organizational  Effectiveness  in  Military 
Organizations "  . 

2.  The  thesis  topic  has  been  approved  by  the  Chief  of 
Personnel  and  is  being  supervised  by  Che  District  Psychology 
Officer,  HQ  3  MD .  A  pilot  survey  has  been  completed  using 
Officers  in  the  Melbourne  Area  and  the  final  study  questionaire 
is  now  ready  for  wider  distribution,  consequently  the  Military 
Secretary  has  provided  a  mailing  list  of  380  randomly  selected 
Majors  and  Lieutenant  Colonels  to  assist  in  the  study  by 
completing  the  attached  questionnaire.  Total  anonymity  of 
respondents  has  been  arranged  to  ensure  the  confidentiality  of 
Individual  replies. 

3.  This  study  will  provide  an  important  source  of 
information  that  should  prove  beneficial  to  the  Army.  It  is 
therefore  requested  that  you  answer  and  return  the  questionnaire 
by  the  due  date. 

K.R.  PHILLIPS 
Brigadier 

Deputy  Chief  of  Personnel  -  Army 
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Management  Intervention  Responses 


Intervention  that  the  organisation  "makes  the  best  use  of" 


Intervention 

Freguency 

Per  cent 

Ranking 

Training  4  instruction 

117 

46 . 2 

1 

Appraisal  4  feedback 

27 

10.7 

2/3 

Supervisory  methods 

27 

10.7 

2/3 

Goal  setting 

20 

7.9 

4 

Organisation  structure 

16 

6 . 3 

5 

Recruitment  4  selection 

15 

3 . 9 

6 

Work  redesign 

9 

3 . 6 

7 

Work  schedules 

7 

2 . 8 

8 

Decision  making 

5 

2 . 0 

9 

Sociotechnical  intervention2 

.  8 

10 

Financial  compensation 

0 

0 

11 

The  single  intervention  "not  well  used 


I ntervent ion 

Freguency 

Per  cent 

Ranking 

Financial  compensation 

84 

33 . 2 

1 

Sociotechnical  interventions  57 

22.5 

2 

Appraisal  4  feedback 

20 

7 . 9 

3 

Work  redesign 

19 

7 . 5 

4 

Goal  setting 

17 

6 . 7 

5 

Organisational  structure 

14 

5 . 5 

6 

Decision  making 

13 

5.1 

7 

Recruitment  4  selection 

12 

4 . 7 

8 

Supervisory  methods 

5 

2 . 0 

9 

Training  4  instruction 

4 

1 . 6 

10 

Work  schedules 

3 

1  .  2 

11 

i 


Intervention  that 

“receives  most 

attention 

in  own  Job 

Intervention 

Frequency 

Per  cent 

Ranking 

Appraisal  &  feedback 

55 

21.7 

1 

Goal  setting 

47 

18 . 6 

2 

Supervisory  methods 

35 

13.8 

3 

Training  &  instruction 

32 

12.6 

4 

Work  schedules 

22 

8 . 7 

5 

Decision  making 

20 

7 . 9 

6 

Organisation  structure 

14 

5 . 5 

7 

Soclotechnical  interventions  10 

4 . 0 

8 

Recruitment  &  selection 

7 

2 . 8 

9 

1 

Work  redesign 

6 

2 . 4 

10 

Financial  compensation 

0 

0 

1 1 

Interventions  respondants  have  "most  experience  in  using" 


Intervention 

Frequency 

Per  cent 

Rank i ng 

Training  *  instruction 

71 

28 . 1 

1 

Apraisal  &  feedback 

64 

25 . 3 

2 

Supervisory  methods 

39 

15.4 

3 

Goal  setting 

27 

10.7 

4 

Decision  making 

1 5 

5 . 9 

5 

Organisation  structure 

8 

3 . 2 

6 

Soclotechnical  interventions  7 

2 . 8 

7 

Recruitment  4  selection 

6 

2  .  4 

8 

Work  redesign 

6 

2 .4 

9 

Work  schedules 

6 

2 . 4 

10 

Financial  compensation 

0 

0 

1 1 

\ 

^  * 


AffEX  F 


Career  Intentions  by  Corps 


Continue 

Retire 

Resign  Onen 

to  offers 

Total 

CorBs 

RAAC 

11 

1 

4 

16 

(6. 

3% 

RAA 

14 

1 

1 

7 

23 

(9. 

1*) 

RAE 

13 

3 

7 

23 

(9. 

1%) 

RA  Svy 

3 

2 

2 

7 

(2. 

8*) 

RA  Slgs 

5 

1 

3 

7 

16 

(6. 

3%) 

RA  Inf 

28 

6 

16 

50 

(19 

.  8%) 

AA  Avn 

3 

1 

3 

5 

(2. 

0%) 

Aust  Int 

2 

2 

4 

(1- 

6%) 

RACT 

10 

1 

8 

19 

(7. 

5%) 

RAAMC 

4 

1 

5 

(2. 

0%) 

RAADC 

2 

1 

2 

5 

(2. 

0%) 

RAAOC 

18 

4 

23 

45 

(17 

.  9%) 

RAE.ME 

8 

8 

16 

(16 

.3%) 

RAAEC 

1 

2 

4 

7 

(2. 

8%) 

AALC 

1 

1 

(0. 

4%) 

RACMP 

2 

4 

6 

(2. 

4%) 

AACC 

1 

1 

(0. 

4%) 

RAANC 

1 

1 

(0. 

4%) 

AABC 

1 

1 

(0. 

4%) 

127 

3 

26 

96 

252 

50 . 4% 

1  .  2% 

10.3% 

38 . 1% 

100 

m€X  G 


» 


Questionnaire  Detailed  Factor  Analyses 


I  ten 

Loading 

Item 

Loading 

Item 

Loading 

Item 

Loading 

Item 

Loading 

Job  Inventory 

Meanineful 

Freedom/ 

Task 

Resources 

Career 

Work 

Autonomy 

Accomollshaent 

Development 

J02 

.85 

J25 

.38 

J25 

.40 

J24 

.32 

JOl 

.36 

Jll 

.81 

J15 

.36 

J15 

.40 

J08 

.87 

J18 

.30 

J20 

.70 

J13 

.88 

JIO 

.30 

JOT 

.86 

J22 

.79 

JOl 

.62 

J03 

.86 

J18 

.75 

J06 

.65 

J21 

.69 

J25 

.59 

J14 

.72 

J19 

.71 

J23 

.54 

J15 

.59 

JIO 

.57 

J16 

.50 

J14 

.30 

J24 

.37 

JOT 

.56 

JIO 

.37 

J04 

.38 

J04 

.43 

J18 

.30 

J23 

.32 

J16  .37 

f  J04  . 36 


Supervision 


Assistance/ 

Supervisor 

Relations  with 

Respect 

of 

Feedback 

Strengths 

Superior 

Superior 

018 

.81 

021 

.80 

020 

.36 

007 

39 

014 

.78 

002 

.79 

022 

.50 

013 

41 

019 

.77 

015 

.76 

004 

.31 

004 

33 

007 

.67 

005 

.71 

025 

.78 

024 

47 

001 

.67 

006 

.70 

026 

.73 

Oil 

82 

013 

.64 

003 

.67 

027 

.67 

009 

82 

017 

.  55 

012 

.61 

006 

.54 

010 

71 

020 

.52 

008 

.37 

024 

.53 

022  .30 
004  . 45 
027  .39 
010  .37 


Organisation 

Climate 

Job 

Satisfaction 

General 

Pride 

.in 

Organisation 

Organisation 

Job 

Contributions 

Organisation 

Climate 

Strengths 

Related 

to 

Satisfaction 

C12 

.81 

C06 

76 

CIO 

.76 

SOS 

.87 

S04 

.34 

C08 

.81 

COT 

72 

C13 

.72 

Sll 

.82 

SIO 

.68 

C03 

.56 

C14 

53 

COS 

.63 

S09 

.82 

SOI 

.64 

COT 

.32 

COl 

50 

Cll 

.52 

S04 

.54 

S05 

.  55 

COl 

.37 

C04 

48 

C02 

.47 

SOT 

.54 

S12 

.52 

C04 

.43 

Cll 

40 

S02 

.52 

S06 

.46 

C02 

.31 

505 

.39 

506 

.36 

t 


6-2 


Perceived  Effectiveness 


Unit 

Unit 

Bcagiurcfi 

Macage/nfint 

Ouantltv  and 

aualiis-gl 

Performance 

Solldarltv 

Shortfalls 

Exoertlse 

Outout 

SPERF  .74 

UPER 

.41 

EQUIP  .78 

OQAN  . 39 

ACONO 

.30 

GMAN  .70 

MRES 

.33 

SHORT  .76 

EMCON  .74 

AGOAL 

.41 

UDEAD  .67 

TCON 

.37 

TEXP  .69 

CFMAN  .63 

IQAN 

.75 

UPRES  .63 

NATES 

.77 

A60AL  .44 

IQOAL 

.69 

ACONO  .60 

TEAM 

.76 

QUAL  . 34 
UPERF  .53 
XRES  . 49 
OQAN  . 48 
TCON  . 47 
TEXT  .31 


I 


t 


